2023-08-10T09:59:29.561 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T09:59:29.562 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551 --owner scheduled_rishabh@teuthology --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551/orig.config.yaml 2023-08-10T09:59:29.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T09:59:29.688 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551 branch: wip-rishabh-2023Aug1-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7364551' kernel: client: sha1: distro flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Aug1-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_09:50:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-10T09:59:29.688 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa; will attempt to use it 2023-08-10T09:59:29.689 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks 2023-08-10T09:59:29.689 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-10T09:59:29.691 INFO:teuthology.task.internal:Checking packages... 2023-08-10T09:59:29.720 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a8bf445f2d27d8e12e060dff0fd151d481b5290b' 2023-08-10T09:59:29.720 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-10T09:59:29.721 INFO:teuthology.packaging:ref: None 2023-08-10T09:59:29.721 INFO:teuthology.packaging:tag: None 2023-08-10T09:59:29.721 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-3 2023-08-10T09:59:29.721 INFO:teuthology.packaging:sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T09:59:29.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Aug1-3 2023-08-10T09:59:29.860 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5118.ga8bf445f 2023-08-10T09:59:29.860 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-10T09:59:29.867 INFO:teuthology.task.internal:no buildpackages task found 2023-08-10T09:59:29.867 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-10T09:59:29.884 INFO:teuthology.task.internal:Saving configuration 2023-08-10T09:59:29.900 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-10T09:59:29.906 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T09:59:29.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:01.665447', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T09:59:29.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:01.664144', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T09:59:29.952 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-10T09:59:29.958 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-10T09:59:29.958 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-10T09:59:29.958 INFO:teuthology.run_tasks:Running task console_log... 2023-08-10T09:59:30.029 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f964f802f70>, signals=[15]) 2023-08-10T09:59:30.030 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-10T09:59:30.036 INFO:teuthology.task.internal:Opening connections... 2023-08-10T09:59:30.036 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T09:59:30.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:30.103 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T09:59:30.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:30.171 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-10T09:59:30.176 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-08-10T09:59:30.193 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-08-10T09:59:30.194 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-08-10T09:59:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T09:59:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T09:59:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-08-10T09:59:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-08-10T09:59:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T09:59:30.250 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T09:59:30.251 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T09:59:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T09:59:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T09:59:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T09:59:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T09:59:30.252 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-08-10T09:59:30.271 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-08-10T09:59:30.291 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-08-10T09:59:30.291 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-08-10T09:59:30.349 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T09:59:30.350 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T09:59:30.351 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T09:59:30.352 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T09:59:30.352 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T09:59:30.352 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-08-10T09:59:30.370 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-10T09:59:30.379 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-10T09:59:30.384 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-10T09:59:30.384 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-08-10T09:59:30.386 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-08-10T09:59:30.407 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-10T09:59:30.413 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-10T09:59:30.414 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-08-10T09:59:30.442 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-08-10T09:59:30.476 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-10T09:59:30.530 INFO:teuthology.run_tasks:Running task kernel... 2023-08-10T09:59:30.547 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-10T09:59:30.548 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-08-10T09:59:30.548 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-08-10T09:59:30.549 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T09:59:30.549 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T09:59:30.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T09:59:30.565 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-08-10T09:59:30.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T09:59:30.567 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-08-10T09:59:30.621 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:30.621 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:30.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2023-08-10T09:59:30.623 INFO:teuthology.orchestra.run.smithi175.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:30.624 INFO:teuthology.task.kernel:Running kernel on smithi175: 4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:30.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2023-08-10T09:59:31.805 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:31.805 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-08-10T09:59:31.906 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:31.906 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-08-10T09:59:33.385 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-08-10T09:59:33.521 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-08-10T09:59:36.776 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 16 MB 00:03 2023-08-10T09:59:37.213 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-08-10T09:59:40.309 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 232 kB/s | 24 kB 00:00 2023-08-10T09:59:40.629 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 390 kB/s | 24 kB 00:00 2023-08-10T09:59:41.012 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-10T09:59:41.065 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-08-10T09:59:41.066 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2023-08-10T09:59:41.066 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-08-10T09:59:41.181 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2023-08-10T09:59:41.399 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-10T09:59:41.446 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-08-10T09:59:41.447 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-08-10T09:59:41.447 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-08-10T09:59:41.510 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:41.511 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-08-10T09:59:41.559 DEBUG:teuthology.orchestra.run.smithi161:> echo no | sudo yum reinstall kernel || true 2023-08-10T09:59:41.769 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:01 ago on Thu 10 Aug 2023 09:59:40 AM UTC. 2023-08-10T09:59:41.813 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T09:59:41.854 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-08-10T09:59:41.891 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:41.891 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-08-10T09:59:41.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2023-08-10T09:59:42.153 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:02 ago on Thu 10 Aug 2023 09:59:40 AM UTC. 2023-08-10T09:59:42.196 INFO:teuthology.orchestra.run.smithi161.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T09:59:42.226 INFO:teuthology.orchestra.run.smithi161.stderr:Error: No packages marked for reinstall. 2023-08-10T09:59:42.228 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:42.228 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-08-10T09:59:42.273 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum reinstall -y kernel || true 2023-08-10T09:59:42.480 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:02 ago on Thu 10 Aug 2023 09:59:40 AM UTC. 2023-08-10T09:59:42.520 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T09:59:42.547 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-08-10T09:59:42.594 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2023-08-10T09:59:42.607 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T09:59:42.607 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-08-10T09:59:42.673 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:42.674 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:42.674 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-10T09:59:42.675 DEBUG:teuthology.parallel:result is None 2023-08-10T09:59:42.859 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:02 ago on Thu 10 Aug 2023 09:59:40 AM UTC. 2023-08-10T09:59:42.900 INFO:teuthology.orchestra.run.smithi161.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T09:59:42.924 INFO:teuthology.orchestra.run.smithi161.stderr:Error: No packages marked for reinstall. 2023-08-10T09:59:42.976 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2023-08-10T09:59:43.056 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:43.057 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-10T09:59:43.057 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-10T09:59:43.057 DEBUG:teuthology.parallel:result is None 2023-08-10T09:59:43.058 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-10T09:59:43.064 INFO:teuthology.task.internal:Creating test directory... 2023-08-10T09:59:43.064 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T09:59:43.067 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T09:59:43.083 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-10T09:59:43.089 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-10T09:59:43.096 INFO:teuthology.task.internal:Creating archive directory... 2023-08-10T09:59:43.096 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T09:59:43.123 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T09:59:43.160 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-10T09:59:43.167 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-10T09:59:43.167 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T09:59:43.190 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T09:59:43.223 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T09:59:43.224 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T09:59:43.234 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T09:59:43.235 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T09:59:43.237 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-10T09:59:43.243 INFO:teuthology.task.internal:Configuring sudo... 2023-08-10T09:59:43.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T09:59:43.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T09:59:43.304 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-10T09:59:43.312 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-10T09:59:43.313 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T09:59:43.344 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T09:59:43.360 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T09:59:43.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T09:59:43.497 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T09:59:43.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T09:59:43.622 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T09:59:43.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T09:59:43.689 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T09:59:43.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T09:59:43.779 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T09:59:43.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T09:59:43.903 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T09:59:43.903 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T09:59:43.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-08-10T09:59:43.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-08-10T09:59:44.024 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T09:59:44.075 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T09:59:44.408 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-10T09:59:44.416 INFO:teuthology.task.internal:Starting timer... 2023-08-10T09:59:44.417 INFO:teuthology.run_tasks:Running task pcp... 2023-08-10T09:59:44.435 INFO:teuthology.run_tasks:Running task selinux... 2023-08-10T09:59:44.443 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-08-10T09:59:44.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-08-10T09:59:44.497 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-08-10T09:59:44.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2023-08-10T09:59:44.564 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2023-08-10T09:59:44.566 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-10T09:59:44.566 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-08-10T09:59:44.597 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-08-10T09:59:44.598 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2023-08-10T09:59:44.618 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2023-08-10T09:59:44.618 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi161.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2023-08-10T09:59:44.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T09:59:44.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T09:59:44.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T09:59:44.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T09:59:44.693 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-10T09:59:44.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-08-10T09:59:44.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2023-08-10T09:59:44.760 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-10T09:59:44.769 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-10T09:59:44.775 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-10T09:59:44.914 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-10T09:59:44.932 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-10T09:59:44.939 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi161.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-10T10:17:12.860 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2023-08-10T10:17:12.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T10:17:12.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:17:12.931 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-08-10T10:17:12.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T10:17:12.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-08-10T10:17:12.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:17:13.063 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-08-10T10:17:13.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-08-10T10:17:13.134 INFO:teuthology.run_tasks:Running task clock... 2023-08-10T10:17:13.145 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-10T10:17:13.145 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:17:13.146 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:17:13.148 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:17:13.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:17:13.177 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:17:13.191 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:17:13.204 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:17:13.218 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:17:13.260 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-08-10T10:17:13.271 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-08-10T10:17:13.285 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:17:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2023-08-10T10:17:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:17:13.306 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2023-08-10T10:17:13.321 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:17:13.335 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:17:13.368 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-08-10T10:17:13.371 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:17:13.371 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-08-10T10:17:13.371 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.372 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.372 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.372 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.407 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-08-10T10:17:13.410 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:17:13.410 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-08-10T10:17:13.410 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.410 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.411 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.411 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:17:13.412 INFO:teuthology.run_tasks:Running task install... 2023-08-10T10:17:13.422 DEBUG:teuthology.task.install:project ceph 2023-08-10T10:17:13.423 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}} 2023-08-10T10:17:13.423 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'} 2023-08-10T10:17:13.423 INFO:teuthology.task.install:Using flavor: default 2023-08-10T10:17:13.429 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-10T10:17:13.429 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-10T10:17:13.430 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:17:13.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:17:13.433 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:17:13.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:17:13.579 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:17:13.580 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:17:13.594 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:17:13.594 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:17:13.693 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:17:13.693 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:17:13.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:17:13.697 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:17:13.697 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:17:13.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:17:13.721 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:17:13.722 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:17:13.725 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:17:13.725 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:17:13.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:17:13.792 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:17:13.866 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:17:13.869 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:17:13.932 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2023-08-10T10:17:13.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2023-08-10T10:17:13.934 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-08-10T10:17:13.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-08-10T10:17:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-08-10T10:17:14.307 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T10:17:15.496 INFO:teuthology.orchestra.run.smithi161.stdout:44 files removed 2023-08-10T10:17:15.507 INFO:teuthology.orchestra.run.smithi175.stdout:44 files removed 2023-08-10T10:17:15.547 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:17:15.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:17:15.878 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T10:17:15.899 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-08-10T10:17:17.424 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 305 kB/s | 81 kB 00:00 2023-08-10T10:17:17.533 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 226 kB/s | 81 kB 00:00 2023-08-10T10:17:17.716 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-08-10T10:17:17.842 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-08-10T10:17:18.092 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-08-10T10:17:18.126 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-08-10T10:17:18.226 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-08-10T10:17:18.269 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-10T10:21:41.911 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:23 2023-08-10T10:21:44.661 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 60 kB/s | 16 MB 04:26 2023-08-10T10:21:45.374 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 487 kB/s | 24 kB 00:00 2023-08-10T10:21:46.251 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 53 MB 00:00 2023-08-10T10:21:48.153 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 418 kB/s | 24 kB 00:00 2023-08-10T10:21:49.012 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-08-10T10:21:54.293 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 MB/s | 47 MB 00:00 2023-08-10T10:21:56.946 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-08-10T10:22:05.296 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:22:05.297 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:22:05.311 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T10:22:05.312 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T10:22:05.313 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:22:05.314 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:22:05.316 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:22:05.319 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:22:05.320 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:22:05.451 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-08-10T10:22:05.463 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-08-10T10:22:05.463 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-08-10T10:22:05.464 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-08-10T10:22:05.464 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2023-08-10T10:22:05.464 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T10:22:05.464 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T10:22:05.464 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:22:05.465 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:22:05.466 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:22:05.467 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:22:05.468 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-08-10T10:22:05.469 INFO:teuthology.orchestra.run.smithi175.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:22:05.470 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T10:22:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:22:05.472 INFO:teuthology.orchestra.run.smithi175.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T10:22:05.473 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T10:22:05.474 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:22:05.475 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:22:05.476 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:22:05.477 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T10:22:05.478 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T10:22:05.479 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:22:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:22:05.481 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout:Enabling module streams: 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql 10 2023-08-10T10:22:05.482 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:22:05.483 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-08-10T10:22:05.483 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-08-10T10:22:05.483 INFO:teuthology.orchestra.run.smithi175.stdout:Install 128 Packages 2023-08-10T10:22:05.483 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 3 Packages 2023-08-10T10:22:05.483 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:22:05.484 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 206 M 2023-08-10T10:22:05.484 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-08-10T10:22:05.818 INFO:teuthology.orchestra.run.smithi175.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-08-10T10:22:06.243 INFO:teuthology.orchestra.run.smithi175.stdout:(2/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 8.2 MB/s | 5.4 MB 00:00 2023-08-10T10:22:06.335 INFO:teuthology.orchestra.run.smithi175.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.8 MB/s | 167 kB 00:00 2023-08-10T10:22:06.627 INFO:teuthology.orchestra.run.smithi175.stdout:(4/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 7.9 MB/s | 2.3 MB 00:00 2023-08-10T10:22:06.835 INFO:teuthology.orchestra.run.smithi175.stdout:(5/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 7.5 MB/s | 1.6 MB 00:00 2023-08-10T10:22:06.861 INFO:teuthology.orchestra.run.smithi175.stdout:(6/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 814 kB/s | 849 kB 00:01 2023-08-10T10:22:07.228 INFO:teuthology.orchestra.run.smithi175.stdout:(7/131): ceph-common-18.0.0-5118.ga8bf445f.el8. 14 MB/s | 22 MB 00:01 2023-08-10T10:22:07.361 INFO:teuthology.orchestra.run.smithi175.stdout:(8/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 8.8 MB/s | 4.6 MB 00:00 2023-08-10T10:22:07.537 INFO:teuthology.orchestra.run.smithi175.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 139 kB/s | 24 kB 00:00 2023-08-10T10:22:07.995 INFO:teuthology.orchestra.run.smithi175.stdout:(10/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el 18 MB/s | 14 MB 00:00 2023-08-10T10:22:08.062 INFO:teuthology.orchestra.run.smithi175.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 3.8 MB/s | 260 kB 00:00 2023-08-10T10:22:08.120 INFO:teuthology.orchestra.run.smithi175.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 533 kB/s | 31 kB 00:00 2023-08-10T10:22:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:22:08.145 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:22:08.159 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T10:22:08.160 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T10:22:08.161 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:22:08.163 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:22:08.165 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:22:08.168 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:22:08.169 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:22:08.221 INFO:teuthology.orchestra.run.smithi175.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 7.5 MB/s | 772 kB 00:00 2023-08-10T10:22:08.296 INFO:teuthology.orchestra.run.smithi175.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.8 MB/s | 139 kB 00:00 2023-08-10T10:22:08.299 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-08-10T10:22:08.311 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-08-10T10:22:08.311 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-08-10T10:22:08.311 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-08-10T10:22:08.311 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-08-10T10:22:08.312 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T10:22:08.312 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T10:22:08.312 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:22:08.312 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:22:08.312 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:22:08.313 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:22:08.313 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:22:08.313 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:22:08.313 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:22:08.313 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:22:08.314 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:22:08.314 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:22:08.314 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T10:22:08.315 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T10:22:08.316 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:22:08.317 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-08-10T10:22:08.318 INFO:teuthology.orchestra.run.smithi161.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T10:22:08.319 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:22:08.319 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:22:08.319 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-08-10T10:22:08.319 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T10:22:08.319 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:22:08.320 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T10:22:08.321 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T10:22:08.322 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:22:08.322 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T10:22:08.322 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T10:22:08.322 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:22:08.322 INFO:teuthology.orchestra.run.smithi161.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T10:22:08.323 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T10:22:08.323 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T10:22:08.323 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:22:08.323 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T10:22:08.323 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:22:08.324 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T10:22:08.324 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T10:22:08.324 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:22:08.324 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T10:22:08.325 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T10:22:08.325 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T10:22:08.325 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T10:22:08.325 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T10:22:08.325 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:22:08.326 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:22:08.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T10:22:08.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:22:08.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T10:22:08.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:22:08.331 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:22:08.332 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:22:08.333 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T10:22:08.334 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:22:08.334 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T10:22:08.334 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T10:22:08.334 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T10:22:08.335 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-08-10T10:22:08.335 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql 10 2023-08-10T10:22:08.335 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:22:08.335 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-08-10T10:22:08.336 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-08-10T10:22:08.336 INFO:teuthology.orchestra.run.smithi161.stdout:Install 128 Packages 2023-08-10T10:22:08.336 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 3 Packages 2023-08-10T10:22:08.336 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:22:08.337 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 206 M 2023-08-10T10:22:08.337 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-08-10T10:22:08.380 INFO:teuthology.orchestra.run.smithi175.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 1.6 MB/s | 139 kB 00:00 2023-08-10T10:22:08.463 INFO:teuthology.orchestra.run.smithi175.stdout:(16/131): libradosstriper1-18.0.0-5118.ga8bf445 5.6 MB/s | 473 kB 00:00 2023-08-10T10:22:08.521 INFO:teuthology.orchestra.run.smithi161.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 38 kB/s | 6.4 kB 00:00 2023-08-10T10:22:09.022 INFO:teuthology.orchestra.run.smithi175.stdout:(17/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 12 MB/s | 6.8 MB 00:00 2023-08-10T10:22:09.089 INFO:teuthology.orchestra.run.smithi175.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 674 kB/s | 45 kB 00:00 2023-08-10T10:22:09.156 INFO:teuthology.orchestra.run.smithi175.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.8 MB/s | 122 kB 00:00 2023-08-10T10:22:09.180 INFO:teuthology.orchestra.run.smithi161.stdout:(2/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.3 MB/s | 849 kB 00:00 2023-08-10T10:22:09.290 INFO:teuthology.orchestra.run.smithi175.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 1.4 MB/s | 197 kB 00:00 2023-08-10T10:22:09.297 INFO:teuthology.orchestra.run.smithi161.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.4 MB/s | 167 kB 00:00 2023-08-10T10:22:09.382 INFO:teuthology.orchestra.run.smithi175.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 4.0 MB/s | 371 kB 00:00 2023-08-10T10:22:09.465 INFO:teuthology.orchestra.run.smithi175.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 4.3 MB/s | 364 kB 00:00 2023-08-10T10:22:09.541 INFO:teuthology.orchestra.run.smithi175.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.4 MB/s | 107 kB 00:00 2023-08-10T10:22:09.608 INFO:teuthology.orchestra.run.smithi175.stdout:(24/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.4 MB/s | 93 kB 00:00 2023-08-10T10:22:10.147 INFO:teuthology.orchestra.run.smithi161.stdout:(4/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-08-10T10:22:10.224 INFO:teuthology.orchestra.run.smithi175.stdout:(25/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 5.7 MB/s | 3.5 MB 00:00 2023-08-10T10:22:10.341 INFO:teuthology.orchestra.run.smithi175.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 1.5 MB/s | 179 kB 00:00 2023-08-10T10:22:10.408 INFO:teuthology.orchestra.run.smithi175.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5118.g 347 kB/s | 23 kB 00:00 2023-08-10T10:22:10.455 INFO:teuthology.orchestra.run.smithi161.stdout:(5/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 5.0 MB/s | 1.6 MB 00:00 2023-08-10T10:22:10.484 INFO:teuthology.orchestra.run.smithi175.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.7 MB/s | 129 kB 00:00 2023-08-10T10:22:10.539 INFO:teuthology.orchestra.run.smithi161.stdout:(6/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-08-10T10:22:10.717 INFO:teuthology.orchestra.run.smithi175.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 7.4 MB/s | 1.7 MB 00:00 2023-08-10T10:22:11.776 INFO:teuthology.orchestra.run.smithi175.stdout:(30/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 11 MB/s | 48 MB 00:04 2023-08-10T10:22:11.860 INFO:teuthology.orchestra.run.smithi175.stdout:(31/131): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-08-10T10:22:11.884 INFO:teuthology.orchestra.run.smithi175.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5118.ga8 2.2 MB/s | 241 kB 00:00 2023-08-10T10:22:11.910 INFO:teuthology.orchestra.run.smithi175.stdout:(33/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 945 kB/s | 47 kB 00:00 2023-08-10T10:22:11.914 INFO:teuthology.orchestra.run.smithi161.stdout:(7/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 3.2 MB/s | 4.6 MB 00:01 2023-08-10T10:22:11.935 INFO:teuthology.orchestra.run.smithi175.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5118.ga 289 kB/s | 15 kB 00:00 2023-08-10T10:22:11.994 INFO:teuthology.orchestra.run.smithi175.stdout:(35/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 2.8 MB/s | 168 kB 00:00 2023-08-10T10:22:12.036 INFO:teuthology.orchestra.run.smithi175.stdout:(36/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 2.0 MB/s | 258 kB 00:00 2023-08-10T10:22:12.061 INFO:teuthology.orchestra.run.smithi175.stdout:(37/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 269 kB/s | 18 kB 00:00 2023-08-10T10:22:13.398 INFO:teuthology.orchestra.run.smithi161.stdout:(8/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x86 6.2 MB/s | 18 MB 00:02 2023-08-10T10:22:13.440 INFO:teuthology.orchestra.run.smithi161.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 589 kB/s | 24 kB 00:00 2023-08-10T10:22:15.065 INFO:teuthology.orchestra.run.smithi161.stdout:(10/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el 4.3 MB/s | 14 MB 00:03 2023-08-10T10:22:15.157 INFO:teuthology.orchestra.run.smithi161.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 2.8 MB/s | 260 kB 00:00 2023-08-10T10:22:15.382 INFO:teuthology.orchestra.run.smithi161.stdout:(12/131): ceph-common-18.0.0-5118.ga8bf445f.el8 3.2 MB/s | 22 MB 00:07 2023-08-10T10:22:15.407 INFO:teuthology.orchestra.run.smithi161.stdout:(13/131): libcephfs-devel-18.0.0-5118.ga8bf445f 124 kB/s | 31 kB 00:00 2023-08-10T10:22:15.444 INFO:teuthology.orchestra.run.smithi175.stdout:(38/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x8 2.1 MB/s | 18 MB 00:08 2023-08-10T10:22:15.491 INFO:teuthology.orchestra.run.smithi161.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.6 MB/s | 139 kB 00:00 2023-08-10T10:22:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:(15/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 4.5 MB/s | 772 kB 00:00 2023-08-10T10:22:15.575 INFO:teuthology.orchestra.run.smithi161.stdout:(16/131): librados-devel-18.0.0-5118.ga8bf445f. 1.6 MB/s | 139 kB 00:00 2023-08-10T10:22:15.675 INFO:teuthology.orchestra.run.smithi161.stdout:(17/131): libradosstriper1-18.0.0-5118.ga8bf445 3.7 MB/s | 473 kB 00:00 2023-08-10T10:22:15.733 INFO:teuthology.orchestra.run.smithi161.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 770 kB/s | 45 kB 00:00 2023-08-10T10:22:15.800 INFO:teuthology.orchestra.run.smithi161.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.8 MB/s | 122 kB 00:00 2023-08-10T10:22:15.867 INFO:teuthology.orchestra.run.smithi161.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 2.9 MB/s | 197 kB 00:00 2023-08-10T10:22:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 3.6 MB/s | 371 kB 00:00 2023-08-10T10:22:16.068 INFO:teuthology.orchestra.run.smithi161.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 3.6 MB/s | 364 kB 00:00 2023-08-10T10:22:16.135 INFO:teuthology.orchestra.run.smithi161.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.6 MB/s | 107 kB 00:00 2023-08-10T10:22:16.202 INFO:teuthology.orchestra.run.smithi161.stdout:(24/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.4 MB/s | 93 kB 00:00 2023-08-10T10:22:16.602 INFO:teuthology.orchestra.run.smithi161.stdout:(25/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 6.6 MB/s | 6.8 MB 00:01 2023-08-10T10:22:16.661 INFO:teuthology.orchestra.run.smithi161.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 3.0 MB/s | 179 kB 00:00 2023-08-10T10:22:16.703 INFO:teuthology.orchestra.run.smithi161.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5118.g 554 kB/s | 23 kB 00:00 2023-08-10T10:22:16.753 INFO:teuthology.orchestra.run.smithi161.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 2.5 MB/s | 129 kB 00:00 2023-08-10T10:22:16.904 INFO:teuthology.orchestra.run.smithi161.stdout:(29/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 5.0 MB/s | 3.5 MB 00:00 2023-08-10T10:22:17.387 INFO:teuthology.orchestra.run.smithi161.stdout:(30/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 12 MB/s | 48 MB 00:03 2023-08-10T10:22:17.438 INFO:teuthology.orchestra.run.smithi161.stdout:(31/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 2.5 MB/s | 1.7 MB 00:00 2023-08-10T10:22:17.471 INFO:teuthology.orchestra.run.smithi161.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5118.ga8 2.8 MB/s | 241 kB 00:00 2023-08-10T10:22:17.496 INFO:teuthology.orchestra.run.smithi161.stdout:(33/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 815 kB/s | 47 kB 00:00 2023-08-10T10:22:17.522 INFO:teuthology.orchestra.run.smithi161.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5118.ga 290 kB/s | 15 kB 00:00 2023-08-10T10:22:17.572 INFO:teuthology.orchestra.run.smithi161.stdout:(35/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 3.4 MB/s | 258 kB 00:00 2023-08-10T10:22:17.605 INFO:teuthology.orchestra.run.smithi161.stdout:(36/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 2.0 MB/s | 168 kB 00:00 2023-08-10T10:22:17.631 INFO:teuthology.orchestra.run.smithi161.stdout:(37/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 308 kB/s | 18 kB 00:00 2023-08-10T10:22:18.048 INFO:teuthology.orchestra.run.smithi161.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-08-10T10:24:21.101 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:21.102 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:21.548 INFO:teuthology.orchestra.run.smithi175.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 465 B/s | 59 kB 02:09 2023-08-10T10:24:21.723 INFO:teuthology.orchestra.run.smithi175.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.4 kB/s | 306 kB 02:09 2023-08-10T10:24:25.196 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:25.581 INFO:teuthology.orchestra.run.smithi175.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 590 B/s | 75 kB 02:10 2023-08-10T10:24:25.806 INFO:teuthology.orchestra.run.smithi175.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 823 kB/s | 185 kB 00:00 2023-08-10T10:24:25.956 INFO:teuthology.orchestra.run.smithi175.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 220 kB/s | 33 kB 00:00 2023-08-10T10:24:26.057 INFO:teuthology.orchestra.run.smithi175.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-08-10T10:24:26.324 INFO:teuthology.orchestra.run.smithi175.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 648 kB/s | 173 kB 00:00 2023-08-10T10:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.1 MB/s | 384 kB 00:00 2023-08-10T10:24:26.816 INFO:teuthology.orchestra.run.smithi175.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 574 kB/s | 81 kB 00:00 2023-08-10T10:24:26.958 INFO:teuthology.orchestra.run.smithi175.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-08-10T10:24:27.074 INFO:teuthology.orchestra.run.smithi175.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2023-08-10T10:24:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:24:27.775 INFO:teuthology.orchestra.run.smithi175.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2023-08-10T10:24:27.805 INFO:teuthology.orchestra.run.smithi161.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 462 B/s | 59 kB 02:10 2023-08-10T10:24:27.830 INFO:teuthology.orchestra.run.smithi161.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 592 B/s | 75 kB 02:09 2023-08-10T10:24:27.855 INFO:teuthology.orchestra.run.smithi161.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.4 kB/s | 306 kB 02:10 2023-08-10T10:24:27.916 INFO:teuthology.orchestra.run.smithi175.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 344 kB/s | 49 kB 00:00 2023-08-10T10:24:27.972 INFO:teuthology.orchestra.run.smithi161.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-08-10T10:24:27.998 INFO:teuthology.orchestra.run.smithi161.stdout:(43/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 261 kB/s | 44 kB 00:00 2023-08-10T10:24:28.067 INFO:teuthology.orchestra.run.smithi175.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 391 kB/s | 59 kB 00:00 2023-08-10T10:24:28.090 INFO:teuthology.orchestra.run.smithi161.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-08-10T10:24:28.115 INFO:teuthology.orchestra.run.smithi161.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2023-08-10T10:24:28.190 INFO:teuthology.orchestra.run.smithi161.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-08-10T10:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 483 kB/s | 60 kB 00:00 2023-08-10T10:24:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 814 kB/s | 81 kB 00:00 2023-08-10T10:24:28.391 INFO:teuthology.orchestra.run.smithi161.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-08-10T10:24:28.434 INFO:teuthology.orchestra.run.smithi175.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-08-10T10:24:28.500 INFO:teuthology.orchestra.run.smithi161.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-08-10T10:24:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 117 kB/s | 16 kB 00:00 2023-08-10T10:24:28.650 INFO:teuthology.orchestra.run.smithi161.stdout:(50/131): python3-asyncssh-2.7.0-2.el8.noarch.r 563 kB/s | 476 kB 00:00 2023-08-10T10:24:28.693 INFO:teuthology.orchestra.run.smithi175.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 269 kB/s | 34 kB 00:00 2023-08-10T10:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 488 kB/s | 49 kB 00:00 2023-08-10T10:24:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:(52/131): python3-cherrypy-18.4.0-1.el8.noarch. 583 kB/s | 384 kB 00:00 2023-08-10T10:24:28.843 INFO:teuthology.orchestra.run.smithi175.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-08-10T10:24:28.851 INFO:teuthology.orchestra.run.smithi161.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-08-10T10:24:28.876 INFO:teuthology.orchestra.run.smithi161.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-08-10T10:24:28.918 INFO:teuthology.orchestra.run.smithi161.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 2.8 MB/s | 1.2 MB 00:00 2023-08-10T10:24:28.968 INFO:teuthology.orchestra.run.smithi175.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 514 kB/s | 64 kB 00:00 2023-08-10T10:24:28.977 INFO:teuthology.orchestra.run.smithi161.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-08-10T10:24:29.010 INFO:teuthology.orchestra.run.smithi161.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-08-10T10:24:29.085 INFO:teuthology.orchestra.run.smithi175.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-08-10T10:24:29.110 INFO:teuthology.orchestra.run.smithi161.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 643 kB/s | 64 kB 00:00 2023-08-10T10:24:29.202 INFO:teuthology.orchestra.run.smithi161.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-08-10T10:24:29.227 INFO:teuthology.orchestra.run.smithi175.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 169 kB/s | 24 kB 00:00 2023-08-10T10:24:29.228 INFO:teuthology.orchestra.run.smithi161.stdout:(60/131): python3-pecan-1.3.2-9.el8.noarch.rpm 751 kB/s | 283 kB 00:00 2023-08-10T10:24:29.253 INFO:teuthology.orchestra.run.smithi161.stdout:(61/131): python3-routes-2.4.1-12.el8.noarch.rp 711 kB/s | 196 kB 00:00 2023-08-10T10:24:29.305 INFO:teuthology.orchestra.run.smithi161.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-08-10T10:24:29.345 INFO:teuthology.orchestra.run.smithi161.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2023-08-10T10:24:29.352 INFO:teuthology.orchestra.run.smithi175.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 234 kB/s | 29 kB 00:00 2023-08-10T10:24:29.387 INFO:teuthology.orchestra.run.smithi161.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-08-10T10:24:29.461 INFO:teuthology.orchestra.run.smithi175.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-08-10T10:24:29.462 INFO:teuthology.orchestra.run.smithi161.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-08-10T10:24:29.513 INFO:teuthology.orchestra.run.smithi161.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-08-10T10:24:29.638 INFO:teuthology.orchestra.run.smithi161.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 487 kB/s | 85 kB 00:00 2023-08-10T10:24:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 153 kB/s | 23 kB 00:00 2023-08-10T10:24:29.678 INFO:teuthology.orchestra.run.smithi175.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-08-10T10:24:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 597 kB/s | 70 kB 00:00 2023-08-10T10:24:29.822 INFO:teuthology.orchestra.run.smithi161.stdout:(70/131): python3-webob-1.8.5-1.el8.1.noarch.rp 527 kB/s | 251 kB 00:00 2023-08-10T10:24:29.862 INFO:teuthology.orchestra.run.smithi175.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-08-10T10:24:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-08-10T10:24:29.939 INFO:teuthology.orchestra.run.smithi161.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-08-10T10:24:29.978 INFO:teuthology.orchestra.run.smithi175.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 525 kB/s | 61 kB 00:00 2023-08-10T10:24:29.998 INFO:teuthology.orchestra.run.smithi161.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-08-10T10:24:30.057 INFO:teuthology.orchestra.run.smithi161.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-10T10:24:30.079 INFO:teuthology.orchestra.run.smithi175.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2023-08-10T10:24:30.179 INFO:teuthology.orchestra.run.smithi175.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-08-10T10:24:30.199 INFO:teuthology.orchestra.run.smithi161.stdout:(75/131): python3-scipy-1.0.0-21.module+el8.5.0 33 MB/s | 14 MB 00:00 2023-08-10T10:24:30.224 INFO:teuthology.orchestra.run.smithi161.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 233 kB/s | 39 kB 00:00 2023-08-10T10:24:30.266 INFO:teuthology.orchestra.run.smithi161.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2023-08-10T10:24:30.308 INFO:teuthology.orchestra.run.smithi161.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-08-10T10:24:30.333 INFO:teuthology.orchestra.run.smithi161.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2023-08-10T10:24:30.400 INFO:teuthology.orchestra.run.smithi161.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-08-10T10:24:30.425 INFO:teuthology.orchestra.run.smithi161.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.1 MB/s | 187 kB 00:00 2023-08-10T10:24:30.459 INFO:teuthology.orchestra.run.smithi161.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 5.8 MB/s | 713 kB 00:00 2023-08-10T10:24:30.484 INFO:teuthology.orchestra.run.smithi161.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 452 kB/s | 27 kB 00:00 2023-08-10T10:24:30.518 INFO:teuthology.orchestra.run.smithi161.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-08-10T10:24:30.543 INFO:teuthology.orchestra.run.smithi161.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 749 kB/s | 44 kB 00:00 2023-08-10T10:24:30.610 INFO:teuthology.orchestra.run.smithi161.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-08-10T10:24:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 24 MB/s | 3.7 MB 00:00 2023-08-10T10:24:30.693 INFO:teuthology.orchestra.run.smithi161.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-08-10T10:24:30.786 INFO:teuthology.orchestra.run.smithi161.stdout:(89/131): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-08-10T10:24:30.811 INFO:teuthology.orchestra.run.smithi161.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-08-10T10:24:30.836 INFO:teuthology.orchestra.run.smithi161.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 888 kB/s | 126 kB 00:00 2023-08-10T10:24:30.837 INFO:teuthology.orchestra.run.smithi175.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 2.6 MB/s | 1.7 MB 00:00 2023-08-10T10:24:30.853 INFO:teuthology.orchestra.run.smithi161.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 299 kB/s | 20 kB 00:00 2023-08-10T10:24:30.863 INFO:teuthology.orchestra.run.smithi175.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-10T10:24:30.878 INFO:teuthology.orchestra.run.smithi161.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-08-10T10:24:30.920 INFO:teuthology.orchestra.run.smithi161.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-08-10T10:24:30.938 INFO:teuthology.orchestra.run.smithi175.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-08-10T10:24:30.945 INFO:teuthology.orchestra.run.smithi161.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-08-10T10:24:30.996 INFO:teuthology.orchestra.run.smithi161.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-08-10T10:24:30.997 INFO:teuthology.orchestra.run.smithi175.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-08-10T10:24:31.047 INFO:teuthology.orchestra.run.smithi175.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 854 kB/s | 43 kB 00:00 2023-08-10T10:24:31.079 INFO:teuthology.orchestra.run.smithi161.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-08-10T10:24:31.097 INFO:teuthology.orchestra.run.smithi175.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-10T10:24:31.113 INFO:teuthology.orchestra.run.smithi161.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-08-10T10:24:31.164 INFO:teuthology.orchestra.run.smithi175.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 721 kB/s | 48 kB 00:00 2023-08-10T10:24:31.180 INFO:teuthology.orchestra.run.smithi161.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-08-10T10:24:31.222 INFO:teuthology.orchestra.run.smithi161.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-08-10T10:24:31.223 INFO:teuthology.orchestra.run.smithi175.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-08-10T10:24:31.264 INFO:teuthology.orchestra.run.smithi161.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-08-10T10:24:31.273 INFO:teuthology.orchestra.run.smithi175.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-08-10T10:24:31.297 INFO:teuthology.orchestra.run.smithi161.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-08-10T10:24:31.323 INFO:teuthology.orchestra.run.smithi161.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.3 MB/s | 200 kB 00:00 2023-08-10T10:24:31.324 INFO:teuthology.orchestra.run.smithi175.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-08-10T10:24:31.348 INFO:teuthology.orchestra.run.smithi161.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 841 kB/s | 43 kB 00:00 2023-08-10T10:24:31.373 INFO:teuthology.orchestra.run.smithi161.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-10T10:24:31.374 INFO:teuthology.orchestra.run.smithi175.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-08-10T10:24:31.399 INFO:teuthology.orchestra.run.smithi161.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 960 kB/s | 48 kB 00:00 2023-08-10T10:24:31.424 INFO:teuthology.orchestra.run.smithi161.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-08-10T10:24:31.432 INFO:teuthology.orchestra.run.smithi175.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-08-10T10:24:31.449 INFO:teuthology.orchestra.run.smithi161.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 845 kB/s | 43 kB 00:00 2023-08-10T10:24:31.475 INFO:teuthology.orchestra.run.smithi161.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-08-10T10:24:31.482 INFO:teuthology.orchestra.run.smithi175.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 375 kB/s | 19 kB 00:00 2023-08-10T10:24:31.500 INFO:teuthology.orchestra.run.smithi161.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-08-10T10:24:31.533 INFO:teuthology.orchestra.run.smithi175.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-08-10T10:24:31.533 INFO:teuthology.orchestra.run.smithi161.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-08-10T10:24:31.559 INFO:teuthology.orchestra.run.smithi161.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-08-10T10:24:31.584 INFO:teuthology.orchestra.run.smithi161.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-10T10:24:31.591 INFO:teuthology.orchestra.run.smithi175.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-08-10T10:24:31.642 INFO:teuthology.orchestra.run.smithi175.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-08-10T10:24:31.659 INFO:teuthology.orchestra.run.smithi161.stdout:(114/131): postgresql-server-10.21-2.module+el8 8.7 MB/s | 5.1 MB 00:00 2023-08-10T10:24:31.685 INFO:teuthology.orchestra.run.smithi161.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 178 kB/s | 18 kB 00:00 2023-08-10T10:24:31.700 INFO:teuthology.orchestra.run.smithi175.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-08-10T10:24:31.710 INFO:teuthology.orchestra.run.smithi161.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-08-10T10:24:31.735 INFO:teuthology.orchestra.run.smithi161.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-08-10T10:24:31.742 INFO:teuthology.orchestra.run.smithi175.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-08-10T10:24:31.769 INFO:teuthology.orchestra.run.smithi161.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-08-10T10:24:31.794 INFO:teuthology.orchestra.run.smithi161.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-08-10T10:24:31.818 INFO:teuthology.orchestra.run.smithi175.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 31 MB/s | 2.3 MB 00:00 2023-08-10T10:24:31.819 INFO:teuthology.orchestra.run.smithi161.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-10T10:24:31.845 INFO:teuthology.orchestra.run.smithi161.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-10T10:24:31.851 INFO:teuthology.orchestra.run.smithi175.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.1 MB/s | 72 kB 00:00 2023-08-10T10:24:31.870 INFO:teuthology.orchestra.run.smithi161.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-10T10:24:31.885 INFO:teuthology.orchestra.run.smithi175.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-08-10T10:24:31.895 INFO:teuthology.orchestra.run.smithi161.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-10T10:24:31.918 INFO:teuthology.orchestra.run.smithi175.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.8 MB/s | 60 kB 00:00 2023-08-10T10:24:31.920 INFO:teuthology.orchestra.run.smithi161.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-08-10T10:24:31.952 INFO:teuthology.orchestra.run.smithi175.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.9 MB/s | 98 kB 00:00 2023-08-10T10:24:31.954 INFO:teuthology.orchestra.run.smithi161.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-08-10T10:24:31.977 INFO:teuthology.orchestra.run.smithi175.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2023-08-10T10:24:31.979 INFO:teuthology.orchestra.run.smithi161.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-08-10T10:24:32.003 INFO:teuthology.orchestra.run.smithi175.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2023-08-10T10:24:32.013 INFO:teuthology.orchestra.run.smithi161.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-08-10T10:24:32.045 INFO:teuthology.orchestra.run.smithi175.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 15 MB/s | 644 kB 00:00 2023-08-10T10:24:32.071 INFO:teuthology.orchestra.run.smithi161.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.4 MB/s | 2.3 MB 00:00 2023-08-10T10:24:32.095 INFO:teuthology.orchestra.run.smithi175.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.4 MB/s | 171 kB 00:00 2023-08-10T10:24:32.137 INFO:teuthology.orchestra.run.smithi175.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-08-10T10:24:32.138 INFO:teuthology.orchestra.run.smithi161.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-08-10T10:24:32.396 INFO:teuthology.orchestra.run.smithi175.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 53 MB/s | 14 MB 00:00 2023-08-10T10:24:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:(130/131): librados2-18.0.0-5118.ga8bf445f.el8. 8.7 MB/s | 3.7 MB 00:00 2023-08-10T10:24:32.437 INFO:teuthology.orchestra.run.smithi175.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-08-10T10:24:32.471 INFO:teuthology.orchestra.run.smithi175.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-08-10T10:24:32.513 INFO:teuthology.orchestra.run.smithi175.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-08-10T10:24:32.555 INFO:teuthology.orchestra.run.smithi175.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-08-10T10:24:32.588 INFO:teuthology.orchestra.run.smithi175.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-08-10T10:24:32.630 INFO:teuthology.orchestra.run.smithi175.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-08-10T10:24:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-08-10T10:24:32.739 INFO:teuthology.orchestra.run.smithi175.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-10T10:24:32.764 INFO:teuthology.orchestra.run.smithi161.stdout:(131/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 4.9 MB/s | 3.6 MB 00:00 2023-08-10T10:24:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:24:32.767 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.4 MB/s | 206 MB 02:24 2023-08-10T10:24:32.781 INFO:teuthology.orchestra.run.smithi175.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-08-10T10:24:32.823 INFO:teuthology.orchestra.run.smithi175.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-08-10T10:24:32.948 INFO:teuthology.orchestra.run.smithi175.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-08-10T10:24:32.982 INFO:teuthology.orchestra.run.smithi175.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 800 kB/s | 27 kB 00:00 2023-08-10T10:24:33.024 INFO:teuthology.orchestra.run.smithi175.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-10T10:24:33.057 INFO:teuthology.orchestra.run.smithi175.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-08-10T10:24:33.149 INFO:teuthology.orchestra.run.smithi175.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 41 MB/s | 3.7 MB 00:00 2023-08-10T10:24:33.191 INFO:teuthology.orchestra.run.smithi175.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-08-10T10:24:33.233 INFO:teuthology.orchestra.run.smithi175.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-08-10T10:24:33.267 INFO:teuthology.orchestra.run.smithi175.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-08-10T10:24:33.301 INFO:teuthology.orchestra.run.smithi175.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.7 MB/s | 126 kB 00:00 2023-08-10T10:24:33.326 INFO:teuthology.orchestra.run.smithi175.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 804 kB/s | 20 kB 00:00 2023-08-10T10:24:33.360 INFO:teuthology.orchestra.run.smithi175.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.0 MB/s | 103 kB 00:00 2023-08-10T10:24:33.410 INFO:teuthology.orchestra.run.smithi175.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-10T10:24:33.518 INFO:teuthology.orchestra.run.smithi175.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 45 MB/s | 4.9 MB 00:00 2023-08-10T10:24:33.547 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-08-10T10:24:33.560 INFO:teuthology.orchestra.run.smithi175.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-08-10T10:24:33.667 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-08-10T10:24:33.667 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-08-10T10:24:33.669 INFO:teuthology.orchestra.run.smithi175.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 44 MB/s | 4.7 MB 00:00 2023-08-10T10:24:33.711 INFO:teuthology.orchestra.run.smithi175.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-10T10:24:33.752 INFO:teuthology.orchestra.run.smithi175.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-10T10:24:33.895 INFO:teuthology.orchestra.run.smithi175.stdout:(124/131): postgresql-server-10.21-2.module+el8 36 MB/s | 5.1 MB 00:00 2023-08-10T10:24:33.953 INFO:teuthology.orchestra.run.smithi175.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-08-10T10:24:34.012 INFO:teuthology.orchestra.run.smithi175.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 26 MB/s | 1.5 MB 00:00 2023-08-10T10:24:34.629 INFO:teuthology.orchestra.run.smithi175.stdout:(127/131): librados2-18.0.0-5118.ga8bf445f.el8. 6.0 MB/s | 3.7 MB 00:00 2023-08-10T10:24:34.777 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-08-10T10:24:34.781 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-08-10T10:24:34.904 INFO:teuthology.orchestra.run.smithi175.stdout:(128/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 13 MB/s | 3.6 MB 00:00 2023-08-10T10:24:34.954 INFO:teuthology.orchestra.run.smithi175.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-08-10T10:24:39.586 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-08-10T10:24:39.770 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T10:24:39.974 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T10:24:40.186 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-10T10:24:40.363 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T10:24:40.462 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T10:24:40.680 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T10:24:41.078 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T10:24:41.304 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:24:41.711 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:24:41.896 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:24:42.024 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:24:42.188 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:24:42.313 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:24:42.493 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:24:42.732 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T10:24:42.940 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T10:24:43.347 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T10:24:43.583 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T10:24:43.754 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:24:43.861 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:24:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:24:44.116 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:24:44.254 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T10:24:44.405 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T10:24:44.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T10:24:45.174 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T10:24:45.354 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T10:24:45.932 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T10:24:46.120 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T10:24:46.804 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T10:24:47.096 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-10T10:24:47.329 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-10T10:24:47.549 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-10T10:24:47.726 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-10T10:24:47.933 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-10T10:24:48.163 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T10:24:48.343 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T10:24:48.489 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T10:24:49.388 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T10:24:49.700 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-10T10:24:49.963 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-10T10:24:50.223 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-10T10:24:50.695 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T10:24:52.443 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T10:24:52.728 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-10T10:24:52.922 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T10:24:53.079 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T10:24:53.241 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T10:24:53.389 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T10:24:53.537 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-10T10:24:53.712 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-10T10:24:53.905 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-10T10:24:54.064 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-10T10:24:54.241 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-10T10:24:54.431 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-10T10:24:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-10T10:24:55.031 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-10T10:24:55.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-10T10:24:55.423 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-10T10:24:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-10T10:24:55.942 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-10T10:24:56.210 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-10T10:24:56.418 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-10T10:24:56.641 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-10T10:24:56.832 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-10T10:24:56.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-10T10:24:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-10T10:24:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-10T10:24:57.765 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-10T10:24:58.000 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-10T10:24:58.184 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-10T10:24:58.336 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-10T10:24:58.527 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T10:24:58.599 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T10:24:58.812 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-10T10:24:59.030 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-10T10:24:59.185 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T10:24:59.261 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T10:24:59.455 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-10T10:24:59.619 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-10T10:24:59.768 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T10:24:59.946 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T10:25:00.210 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T10:25:00.416 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T10:25:00.572 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T10:25:00.762 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T10:25:00.950 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T10:25:01.162 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T10:25:01.353 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T10:25:01.521 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T10:25:01.666 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T10:25:01.881 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T10:25:02.097 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T10:25:02.307 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T10:25:02.566 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T10:25:02.759 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T10:25:02.931 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T10:25:03.177 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T10:25:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T10:25:04.504 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T10:25:04.759 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T10:25:05.051 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T10:25:05.335 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T10:25:05.503 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T10:25:06.303 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T10:25:06.467 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:25:06.530 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:25:06.693 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T10:25:10.353 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:25:10.567 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:25:11.150 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:25:11.709 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:25:11.795 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:25:11.933 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:25:30.632 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:25:30.632 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-08-10T10:25:30.632 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-08-10T10:25:30.632 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /run 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-08-10T10:25:30.633 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:25:30.981 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:25:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:25:32.713 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:25:32.932 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:25:33.072 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:25:33.549 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:25:33.738 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:25:33.756 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:25:35.365 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:25:35.591 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:25:35.694 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T10:25:35.860 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T10:25:36.046 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:25:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:25:36.546 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:25:37.508 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:25:37.671 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:25:37.761 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:25:38.167 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T10:25:38.355 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:25:38.389 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:25:38.537 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:25:38.548 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:25:39.825 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T10:25:40.009 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:25:40.042 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:25:40.220 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:25:40.262 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:25:40.379 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:25:40.732 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:25:40.879 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:25:45.433 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:25:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T10:25:45.836 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T10:25:46.026 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T10:25:46.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-10T10:25:47.218 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-10T10:25:47.421 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/134 2023-08-10T10:25:47.640 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T10:25:47.790 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T10:25:47.929 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:25:50.092 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:25:50.336 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:25:50.353 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:25:50.511 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T10:25:50.768 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T10:25:51.021 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T10:25:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T10:25:51.477 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:25:51.485 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:25:51.659 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-10T10:25:51.868 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T10:25:51.949 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T10:25:52.144 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T10:25:52.156 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T10:25:52.156 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:25:52.363 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:25:52.364 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:25:52.591 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:25:52.776 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:25:53.280 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:25:53.281 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T10:25:53.281 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T10:25:53.282 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T10:25:53.282 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T10:25:53.282 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T10:25:53.282 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:25:53.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:25:53.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:25:53.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:25:53.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T10:25:53.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T10:25:53.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T10:25:53.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T10:25:53.285 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T10:25:53.285 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T10:25:53.285 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T10:25:53.285 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T10:25:53.286 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T10:25:53.286 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T10:25:53.286 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T10:25:53.287 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T10:25:53.287 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T10:25:53.287 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T10:25:53.288 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T10:25:53.288 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T10:25:53.288 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T10:25:53.288 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T10:25:53.289 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T10:25:53.289 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T10:25:53.290 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T10:25:53.290 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T10:25:53.290 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T10:25:53.290 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T10:25:53.291 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T10:25:53.291 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T10:25:53.291 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T10:25:53.292 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T10:25:53.292 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T10:25:53.292 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T10:25:53.293 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T10:25:53.293 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T10:25:53.293 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T10:25:53.294 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T10:25:53.294 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T10:25:53.294 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T10:25:53.294 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T10:25:53.295 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T10:25:53.296 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T10:25:53.296 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T10:25:53.296 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T10:25:53.296 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T10:25:53.297 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T10:25:53.298 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T10:25:53.298 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T10:25:53.298 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T10:25:53.298 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T10:25:53.298 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-10T10:25:53.299 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-10T10:25:53.300 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-10T10:25:53.301 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-10T10:25:53.302 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-10T10:25:53.303 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-10T10:25:53.303 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-10T10:25:53.303 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-10T10:25:53.304 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-10T10:25:53.305 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-10T10:25:53.306 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-10T10:25:53.307 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-10T10:25:53.308 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-10T10:25:53.308 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-10T10:25:53.308 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:25:53.309 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T10:25:53.309 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T10:25:53.309 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T10:25:53.309 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:25:53.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T10:25:55.769 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:25:55.769 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:59 ago on Thu 10 Aug 2023 10:21:56 AM UTC. 2023-08-10T10:25:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:Installed products updated. 2023-08-10T10:25:59.781 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:25:59.781 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-08-10T10:25:59.781 INFO:teuthology.orchestra.run.smithi161.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T10:25:59.781 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.781 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.782 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.783 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.784 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.785 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.785 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.785 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.785 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.786 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.786 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.786 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.786 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.786 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.787 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.787 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.787 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:25:59.787 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T10:25:59.787 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-3.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T10:25:59.788 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:25:59.789 INFO:teuthology.orchestra.run.smithi161.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.790 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T10:25:59.791 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T10:25:59.792 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:25:59.793 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:25:59.794 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:25:59.794 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:25:59.794 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.794 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.794 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.795 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:25:59.795 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T10:25:59.795 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:25:59.795 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:25:59.795 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:25:59.796 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:25:59.797 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:25:59.797 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:25:59.797 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:25:59.797 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:25:59.798 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:25:59.799 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.800 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:25:59.801 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:25:59.802 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:25:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T10:25:59.804 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:25:59.804 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T10:25:59.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:25:59.805 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-08-10T10:25:59.988 DEBUG:teuthology.parallel:result is None 2023-08-10T10:26:32.540 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:26:32.540 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:26:32.900 INFO:teuthology.orchestra.run.smithi175.stdout:(130/131): python3-bcrypt-3.1.6-2.el8.1.x86_64. 340 B/s | 44 kB 02:11 2023-08-10T10:26:33.142 INFO:teuthology.orchestra.run.smithi175.stdout:(131/131): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:11 2023-08-10T10:26:33.143 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:26:33.144 INFO:teuthology.orchestra.run.smithi175.stdout:Total 788 kB/s | 206 MB 04:27 2023-08-10T10:26:33.933 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-08-10T10:26:34.054 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-08-10T10:26:34.054 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-08-10T10:26:35.166 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-08-10T10:26:35.170 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-08-10T10:26:39.954 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-08-10T10:26:40.145 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T10:26:40.340 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T10:26:40.513 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:26:40.638 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:26:40.846 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:26:41.244 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:26:41.496 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:26:41.902 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:26:42.113 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:26:42.224 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:26:42.430 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:26:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:26:42.709 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:26:42.897 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-10T10:26:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T10:26:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T10:26:43.717 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T10:26:44.000 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T10:26:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:26:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:26:44.446 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:26:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:26:44.766 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-10T10:26:44.968 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-10T10:26:45.152 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-10T10:26:45.287 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:26:45.428 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:26:45.587 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:26:46.203 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:26:46.395 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:26:46.994 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:26:47.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:26:47.888 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:26:48.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-10T10:26:48.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-10T10:26:48.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T10:26:48.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T10:26:48.941 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T10:26:49.174 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T10:26:49.378 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:26:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:26:52.141 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-10T10:26:52.460 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-10T10:26:52.721 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-10T10:26:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-10T10:26:53.147 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T10:26:53.354 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T10:26:53.533 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T10:26:53.700 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T10:26:53.851 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-10T10:26:54.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-10T10:26:54.185 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:26:54.246 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:26:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-10T10:26:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-10T10:26:54.835 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:26:54.915 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:26:55.122 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-10T10:26:55.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-10T10:26:55.411 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-10T10:26:55.629 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-10T10:26:55.796 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-10T10:26:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-10T10:26:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-10T10:26:56.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-10T10:26:56.689 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-10T10:26:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-10T10:26:57.221 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-10T10:26:57.473 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-10T10:26:57.673 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-10T10:26:57.959 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-10T10:26:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-10T10:26:58.394 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-10T10:26:58.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-10T10:26:58.789 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-10T10:26:58.946 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-10T10:26:59.260 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-10T10:26:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-10T10:26:59.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-10T10:26:59.994 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-10T10:27:00.150 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T10:27:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T10:27:00.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T10:27:01.108 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T10:27:01.247 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T10:27:01.404 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T10:27:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T10:27:01.855 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T10:27:02.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T10:27:02.196 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T10:27:02.348 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T10:27:02.564 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T10:27:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T10:27:02.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T10:27:03.239 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T10:27:03.467 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T10:27:03.634 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T10:27:03.851 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T10:27:04.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T10:27:05.262 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T10:27:05.500 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T10:27:05.803 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T10:27:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T10:27:06.335 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T10:27:07.136 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T10:27:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:27:07.411 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:27:07.575 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T10:27:11.254 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:27:11.507 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:27:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:27:12.413 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:27:12.495 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:27:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:27:31.485 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:27:31.485 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2023-08-10T10:27:31.485 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2023-08-10T10:27:31.485 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-08-10T10:27:31.485 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /run 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-08-10T10:27:31.486 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:27:31.879 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:27:33.451 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:27:33.643 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:27:33.860 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:27:34.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:27:34.464 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:27:34.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:27:34.661 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:27:36.437 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:27:36.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:27:36.759 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T10:27:36.937 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T10:27:37.119 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:27:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:27:37.666 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:27:38.625 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:27:38.818 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:27:38.909 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:27:39.278 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T10:27:39.466 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:27:39.502 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:27:39.677 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:27:39.688 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:27:40.970 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T10:27:41.204 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:27:41.237 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:27:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:27:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:27:41.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:27:41.920 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:27:42.068 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:27:46.622 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:27:47.490 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T10:27:47.807 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-10T10:27:47.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 117/134 2023-08-10T10:27:48.255 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-10T10:27:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:27:48.591 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:27:48.829 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-10T10:27:49.012 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T10:27:49.168 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:27:51.353 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:27:51.625 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:27:51.643 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:27:51.808 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T10:27:52.074 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T10:27:52.361 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T10:27:52.742 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T10:27:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:27:52.988 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:27:53.183 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:27:53.195 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:27:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:27:53.357 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:27:53.493 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-10T10:27:53.494 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:27:53.711 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:27:53.711 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:27:53.971 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:27:54.156 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:27:54.677 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:27:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T10:27:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T10:27:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T10:27:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T10:27:54.678 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T10:27:54.679 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T10:27:54.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T10:27:54.681 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T10:27:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T10:27:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T10:27:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T10:27:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T10:27:54.689 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T10:27:54.690 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T10:27:54.691 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T10:27:54.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T10:27:54.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T10:27:54.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-10T10:27:54.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-10T10:27:54.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-10T10:27:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-10T10:27:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-10T10:27:54.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-10T10:27:54.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-10T10:27:54.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-10T10:27:54.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-10T10:27:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T10:27:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T10:27:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T10:27:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:27:54.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T10:27:57.124 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:27:57.124 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:06:04 ago on Thu 10 Aug 2023 10:21:53 AM UTC. 2023-08-10T10:28:00.146 INFO:teuthology.orchestra.run.smithi175.stdout:Installed products updated. 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T10:28:00.379 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.6-3.el8.x86_64 2023-08-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi175.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.382 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:28:00.383 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:28:00.384 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:28:00.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:28:00.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:28:00.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:28:00.389 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:28:00.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:28:00.392 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:28:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:28:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:28:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:28:00.393 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:28:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:28:00.394 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:28:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:28:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:28:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T10:28:00.395 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:28:00.396 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T10:28:00.397 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:00.397 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-08-10T10:28:00.565 DEBUG:teuthology.parallel:result is None 2023-08-10T10:28:00.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:28:00.708 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:28:00.738 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:28:00.739 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:28:00.739 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:28:00.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:28:00.952 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:28:00.975 INFO:teuthology.orchestra.run.smithi175.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:28:00.976 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:28:00.976 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:28:00.979 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-10T10:28:00.980 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:00.981 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:28:01.028 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:01.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:28:01.069 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-10T10:28:01.069 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:01.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:28:01.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:28:01.168 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:01.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:28:01.202 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:28:01.268 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-10T10:28:01.269 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:01.269 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:28:01.297 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:28:01.366 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:01.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:28:01.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:28:01.458 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-10T10:28:01.459 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:01.459 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:28:01.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:28:01.554 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:01.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:28:01.580 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:28:01.646 INFO:teuthology.run_tasks:Running task ceph... 2023-08-10T10:28:01.731 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-10T10:28:01.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-08-10T10:28:01.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2023-08-10T10:28:01.760 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-10T10:28:01.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:28:01.801 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:28:01.827 INFO:tasks.ceph:Creating extra log directories... 2023-08-10T10:28:01.828 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:28:01.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:28:01.900 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-10T10:28:01.901 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-10T10:28:01.901 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-10T10:28:01.901 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:01.902 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:28:01.949 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:02.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:02.109 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:02.110 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:28:02.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:02.275 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:02.306 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-10T10:28:02.307 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-10T10:28:02.307 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364551', 'branch': 'wip-rishabh-2023Aug1-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7364551', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Aug1-3'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Aug1-3', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Aug1-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi175.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '7fda95956ac10132c9b74016ba832db907df09fa', 'timestamp': '2023-08-10_09:50:44', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-10T10:28:02.309 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:28:02.311 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:28:02.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:28:02.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:28:02.424 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:02.425 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:28:02.449 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:28:02.450 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-08-10T10:28:02.506 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:28:02.507 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:02.507 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 382411 Links: 1 2023-08-10T10:28:02.507 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:02.507 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:02.507 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-08-10 10:25:52.967154955 +0000 2023-08-10T10:28:02.508 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-08-10 10:16:40.465599661 +0000 2023-08-10T10:28:02.508 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-08-10 10:16:40.465599661 +0000 2023-08-10T10:28:02.508 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-08-10T10:28:02.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:28:02.573 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-08-10T10:28:02.573 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-08-10T10:28:02.573 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00023086 s, 2.2 MB/s 2023-08-10T10:28:02.574 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:28:02.631 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-08-10T10:28:02.690 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:28:02.690 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:02.690 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 386169 Links: 1 2023-08-10T10:28:02.690 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:02.690 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:02.691 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-08-10 10:25:52.967154955 +0000 2023-08-10T10:28:02.691 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-08-10 10:16:40.994588328 +0000 2023-08-10T10:28:02.691 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-08-10 10:16:40.994588328 +0000 2023-08-10T10:28:02.691 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-08-10T10:28:02.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:28:02.755 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-08-10T10:28:02.755 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-08-10T10:28:02.755 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000222994 s, 2.3 MB/s 2023-08-10T10:28:02.757 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:28:02.814 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-08-10T10:28:02.872 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:28:02.872 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:02.872 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 377800 Links: 1 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-08-10 10:25:52.967154955 +0000 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-08-10 10:16:41.538576673 +0000 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-08-10 10:16:41.538576673 +0000 2023-08-10T10:28:02.873 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-08-10T10:28:02.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:28:02.937 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-08-10T10:28:02.937 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-08-10T10:28:02.937 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000203221 s, 2.5 MB/s 2023-08-10T10:28:02.938 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:28:02.996 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-08-10T10:28:03.052 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:28:03.052 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 386305 Links: 1 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-08-10 10:25:52.967154955 +0000 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-08-10 10:16:42.060565489 +0000 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-08-10 10:16:42.060565489 +0000 2023-08-10T10:28:03.053 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-08-10T10:28:03.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:28:03.118 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-08-10T10:28:03.118 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-08-10T10:28:03.118 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000184465 s, 2.8 MB/s 2023-08-10T10:28:03.119 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:28:03.177 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:03.178 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:03.178 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:28:03.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:28:03.195 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-08-10T10:28:03.251 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:28:03.252 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:03.252 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 387218 Links: 1 2023-08-10T10:28:03.252 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:03.253 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:03.253 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-08-10 10:27:54.377908629 +0000 2023-08-10T10:28:03.253 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-08-10 10:14:27.799627689 +0000 2023-08-10T10:28:03.253 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-08-10 10:14:27.799627689 +0000 2023-08-10T10:28:03.254 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-08-10T10:28:03.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:28:03.317 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-08-10T10:28:03.318 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-08-10T10:28:03.318 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000247831 s, 2.1 MB/s 2023-08-10T10:28:03.319 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:28:03.377 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 389136 Links: 1 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:03.435 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-08-10 10:27:54.377908629 +0000 2023-08-10T10:28:03.436 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-08-10 10:14:28.357618957 +0000 2023-08-10T10:28:03.436 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-08-10 10:14:28.357618957 +0000 2023-08-10T10:28:03.436 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-08-10T10:28:03.436 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:28:03.501 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-08-10T10:28:03.501 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-08-10T10:28:03.501 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000241619 s, 2.1 MB/s 2023-08-10T10:28:03.502 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:28:03.560 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-08-10T10:28:03.618 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:28:03.618 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:03.618 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 385241 Links: 1 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-08-10 10:27:54.377908629 +0000 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-08-10 10:14:28.907610351 +0000 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-08-10 10:14:28.907610351 +0000 2023-08-10T10:28:03.619 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-08-10T10:28:03.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:28:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-08-10T10:28:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-08-10T10:28:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000218295 s, 2.3 MB/s 2023-08-10T10:28:03.685 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:28:03.744 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-08-10T10:28:03.801 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:28:03.802 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:28:03.802 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 388461 Links: 1 2023-08-10T10:28:03.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:28:03.802 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:28:03.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-08-10 10:27:54.377908629 +0000 2023-08-10T10:28:03.803 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-08-10 10:14:29.430602168 +0000 2023-08-10T10:28:03.803 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-08-10 10:14:29.430602168 +0000 2023-08-10T10:28:03.803 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-08-10T10:28:03.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:28:03.868 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-08-10T10:28:03.868 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-08-10T10:28:03.868 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000193188 s, 2.7 MB/s 2023-08-10T10:28:03.869 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:28:03.927 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:03.927 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:28:03.928 INFO:tasks.ceph:Generating config... 2023-08-10T10:28:03.929 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-10T10:28:03.929 INFO:tasks.ceph:[client] debug client = 20 2023-08-10T10:28:03.929 INFO:tasks.ceph:[client] debug ms = 1 2023-08-10T10:28:03.930 INFO:tasks.ceph:[client] pid file = 2023-08-10T10:28:03.930 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-10T10:28:03.930 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-10T10:28:03.930 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-10T10:28:03.930 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-10T10:28:03.931 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-10T10:28:03.932 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-10T10:28:03.932 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-10T10:28:03.932 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-10T10:28:03.932 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-10T10:28:03.932 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-10T10:28:03.933 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-10T10:28:03.933 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-10T10:28:03.933 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-10T10:28:03.933 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-10T10:28:03.933 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-10T10:28:03.934 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-10T10:28:03.934 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-10T10:28:03.934 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-10T10:28:03.934 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-10T10:28:03.934 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-10T10:28:03.935 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-10T10:28:03.936 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-10T10:28:03.936 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-10T10:28:03.936 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-10T10:28:03.936 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-10T10:28:03.936 INFO:tasks.ceph:Setting up mon.a... 2023-08-10T10:28:03.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-10T10:28:03.989 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.keyring 2023-08-10T10:28:03.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-10T10:28:04.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:28:04.064 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.161'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2023-08-10T10:28:04.065 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-10T10:28:04.066 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:04.066 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:28:04.121 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:04.208 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:04.209 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e 2023-08-10T10:28:04.209 INFO:teuthology.orchestra.run.smithi161.stdout:setting min_mon_release = pacific 2023-08-10T10:28:04.209 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2023-08-10T10:28:04.209 INFO:teuthology.orchestra.run.smithi161.stdout:fsid bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e 2023-08-10T10:28:04.209 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2023-08-10T10:28:04.209071+0000 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:created 2023-08-10T10:28:04.209071+0000 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 16 (pacific) 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2023-08-10T10:28:04.210 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-10T10:28:04.211 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:28:04.228 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e... 2023-08-10T10:28:04.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:28:04.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:28:04.313 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-08-10T10:28:04.313 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-08-10T10:28:04.313 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:28:04.313 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-08-10T10:28:04.314 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.315 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:28:04.316 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-08-10T10:28:04.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-08-10T10:28:04.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-08-10T10:28:04.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-08-10T10:28:04.320 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.321 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-08-10T10:28:04.322 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-08-10T10:28:04.323 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-08-10T10:28:04.324 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:28:04.325 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-08-10T10:28:04.325 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-08-10T10:28:04.325 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-08-10T10:28:04.325 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.325 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-08-10T10:28:04.326 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-08-10T10:28:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:28:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:28:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-08-10T10:28:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-08-10T10:28:04.331 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-08-10T10:28:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-08-10T10:28:04.333 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-08-10T10:28:04.334 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-08-10T10:28:04.334 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-08-10T10:28:04.334 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-08-10T10:28:04.334 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-08-10T10:28:04.335 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2023-08-10T10:28:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2023-08-10T10:28:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:28:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e 2023-08-10T10:28:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2023-08-10T10:28:04.344 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2023-08-10T10:28:04.345 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2023-08-10T10:28:04.346 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2023-08-10T10:28:04.347 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2023-08-10T10:28:04.348 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2023-08-10T10:28:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:28:04.350 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:28:04.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2023-08-10T10:28:04.352 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-08-10T10:28:04.353 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-08-10T10:28:04.354 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2023-08-10T10:28:04.355 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-08-10T10:28:04.356 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-08-10T10:28:04.356 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-08-10T10:28:04.356 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-10T10:28:04.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-10T10:28:04.433 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-10T10:28:04.433 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:04.434 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-10T10:28:04.450 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:04.451 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-10T10:28:04.507 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:28:04.507 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:04.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:28:04.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:28:04.583 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:04.584 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:04.639 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:28:04.639 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:04.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:28:04.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:28:04.676 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:04.677 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:04.733 INFO:tasks.ceph:Setting up mon nodes... 2023-08-10T10:28:04.733 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-10T10:28:04.734 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:28:04.786 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:28:04.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:28:04.865 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:28:04.868 INFO:tasks.ceph:Setting up mds nodes... 2023-08-10T10:28:04.868 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:28:04.922 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:28:04.924 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-10T10:28:04.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:28:05.045 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:28:05.047 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-10T10:28:05.074 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:28:05.130 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:28:05.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-10T10:28:05.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:28:05.255 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:28:05.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-10T10:28:05.284 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-10T10:28:05.284 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-10T10:28:05.328 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-10T10:28:05.341 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-10T10:28:05.384 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-10T10:28:05.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-10T10:28:05.440 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-10T10:28:05.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-10T10:28:05.498 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-10T10:28:05.512 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-10T10:28:05.513 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:28:05.513 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-10T10:28:05.539 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:05.540 INFO:tasks.ceph:role: osd.0 2023-08-10T10:28:05.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:28:05.540 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:28:05.614 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:05.614 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:05.614 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:05.614 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:05.614 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:05.615 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:05.615 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:05.615 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:05.615 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:05.615 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:06.048 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-08-10T10:28:06.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-08-10T10:28:06.050 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-10T10:28:06.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-10T10:28:06.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-10T10:28:06.344 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:06.344 INFO:tasks.ceph:role: osd.1 2023-08-10T10:28:06.345 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:28:06.345 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:28:06.417 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:06.418 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:06.418 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:06.418 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:06.418 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:06.418 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:06.419 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:06.419 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:06.419 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:06.419 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:06.838 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-08-10T10:28:06.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-08-10T10:28:06.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-10T10:28:06.955 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-10T10:28:06.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-10T10:28:07.052 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:07.052 INFO:tasks.ceph:role: osd.2 2023-08-10T10:28:07.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:28:07.053 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:28:07.125 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:07.126 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:07.127 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:07.127 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:07.127 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:07.571 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-08-10T10:28:07.572 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-08-10T10:28:07.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-10T10:28:07.731 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-10T10:28:07.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-10T10:28:07.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:07.879 INFO:tasks.ceph:role: osd.3 2023-08-10T10:28:07.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:28:07.880 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:28:07.953 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:07.953 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:07.954 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:07.954 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:07.954 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:07.954 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:07.955 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:07.955 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:07.955 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:07.956 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:08.386 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-08-10T10:28:08.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-08-10T10:28:08.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-10T10:28:08.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-10T10:28:08.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:08.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.691+0000 7f80c84bc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-10T10:28:08.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.691+0000 7f80c84bc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-10T10:28:08.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.691+0000 7f80c84bc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:28:08.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.692+0000 7f80c84bc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:28:08.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.692+0000 7f80c84bc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:28:08.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:08.692+0000 7f80c84bc640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-10T10:28:11.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-10T10:28:11.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:11.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-10T10:28:11.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-10T10:28:11.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:28:11.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:28:11.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:28:11.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:11.680+0000 7f40ed5db640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-10T10:28:14.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-10T10:28:14.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:14.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.663+0000 7f66490a1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-10T10:28:14.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.663+0000 7f66490a1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-10T10:28:14.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.663+0000 7f66490a1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:28:14.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.663+0000 7f66490a1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:28:14.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.663+0000 7f66490a1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:28:14.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:14.664+0000 7f66490a1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-10T10:28:17.537 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-10T10:28:17.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.662+0000 7fbfe1f7a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-10T10:28:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.662+0000 7fbfe1f7a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-10T10:28:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.662+0000 7fbfe1f7a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:28:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.662+0000 7fbfe1f7a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:28:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.662+0000 7fbfe1f7a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:28:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:17.663+0000 7fbfe1f7a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-10T10:28:20.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-10T10:28:20.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-10T10:28:20.578 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:20.578 INFO:tasks.ceph:role: osd.4 2023-08-10T10:28:20.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:28:20.579 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:28:20.652 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:20.652 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:20.653 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:20.654 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:21.079 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-08-10T10:28:21.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-08-10T10:28:21.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-10T10:28:21.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-10T10:28:21.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-10T10:28:21.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:21.373 INFO:tasks.ceph:role: osd.5 2023-08-10T10:28:21.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:28:21.374 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:28:21.448 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:21.448 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:21.449 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:21.450 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:21.870 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-08-10T10:28:21.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-08-10T10:28:21.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-10T10:28:21.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-10T10:28:22.016 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-10T10:28:22.083 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:22.084 INFO:tasks.ceph:role: osd.6 2023-08-10T10:28:22.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:28:22.085 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:28:22.157 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:22.159 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:22.603 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-08-10T10:28:22.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-08-10T10:28:22.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-10T10:28:22.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-10T10:28:22.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-10T10:28:22.862 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:28:22.862 INFO:tasks.ceph:role: osd.7 2023-08-10T10:28:22.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:28:22.864 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:28:22.935 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:28:22.936 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:28:22.936 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:28:22.936 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:28:22.936 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:28:22.937 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:28:22.937 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:28:22.937 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:28:22.937 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:28:22.937 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:28:23.379 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-08-10T10:28:23.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-08-10T10:28:23.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-10T10:28:23.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-10T10:28:23.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:23.711 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.710+0000 7efcd2022640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-10T10:28:23.712 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.711+0000 7efcd2022640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-10T10:28:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.711+0000 7efcd2022640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:28:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.711+0000 7efcd2022640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:28:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.711+0000 7efcd2022640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:28:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:23.711+0000 7efcd2022640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-10T10:28:26.585 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-10T10:28:26.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.708+0000 7f099a445640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-10T10:28:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.708+0000 7f099a445640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-10T10:28:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.708+0000 7f099a445640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:28:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.708+0000 7f099a445640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:28:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.709+0000 7f099a445640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:28:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:26.709+0000 7f099a445640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-10T10:28:29.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-10T10:28:29.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:29.695 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-10T10:28:29.696 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-10T10:28:29.696 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:28:29.696 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:28:29.696 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:28:29.696 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:29.695+0000 7f3b22521640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-10T10:28:32.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:32.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:28:32.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-10T10:28:32.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:32.683 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.681+0000 7f394962c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-10T10:28:32.683 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.682+0000 7f394962c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-10T10:28:32.684 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.682+0000 7f394962c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:28:32.684 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.682+0000 7f394962c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:28:32.684 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.682+0000 7f394962c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:28:32.685 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:32.682+0000 7f394962c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-10T10:28:35.545 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-10T10:28:35.576 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-10T10:28:35.577 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-10T10:28:35.609 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.610 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-10T10:28:35.681 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-10T10:28:35.750 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-10T10:28:35.819 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-10T10:28:35.886 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.886 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-10T10:28:35.952 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:35.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-10T10:28:36.020 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.020 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-10T10:28:36.051 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-10T10:28:36.123 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-10T10:28:36.194 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-10T10:28:36.263 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.264 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-10T10:28:36.332 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-10T10:28:36.401 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-10T10:28:36.470 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:36.470 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-10T10:28:36.488 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:36.489 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-10T10:28:36.546 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.547 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-10T10:28:36.564 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:36.565 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-10T10:28:36.621 INFO:tasks.ceph:Adding keys to all mons... 2023-08-10T10:28:36.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:28:36.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:28:36.664 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-08-10T10:28:36.665 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC0u9RkGrfpLhAArjhcAInUtQEZ/GksarmS0g== 2023-08-10T10:28:36.665 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-08-10T10:28:36.665 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC0u9Rk4hf5NhAABDudX5WuXCUCX6/b5FzeqA== 2023-08-10T10:28:36.665 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-08-10T10:28:36.665 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkWqC2AhAAX+sz3tw1o5AzTnwO/i/00w== 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC4u9RkhrBOKRAA1Gnrlfw347KrNlnZ6EaCkg== 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC7u9RkM72PKBAAiZL/W/bW7wQof5EqanYSPg== 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC+u9RktHKPJxAAMn6VWWHMiYZKUJSDvtycAQ== 2023-08-10T10:28:36.666 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-08-10T10:28:36.667 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDBu9RkDFZ9JxAAymZXEREJ56qzs9b54DR1pg== 2023-08-10T10:28:36.667 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-08-10T10:28:36.667 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC0u9Rk2CWgMxAA5JR8LboZnHWzk7eeUxeHnQ== 2023-08-10T10:28:36.667 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-08-10T10:28:36.667 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkwCzPBxAA5QE5xgkVUH8zLiJ7U/FwfA== 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkiXBEDxAAdz/D2bYIQpb/jBLDU2WbmA== 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDHu9Rk5M5oKhAAz4oHySLquHN0ys1M4yFyzw== 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-08-10T10:28:36.668 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDKu9Rkg+NHKhAArOo8iMCwOXWzXjjVVevbYw== 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDNu9Rko693KRAAtWPCq3ejpC4hncanrCsTbw== 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDQu9Rkk+itKBAA6rbePsSNcKrJes/wJEqq1g== 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkxHySExAA2njciOh3wsl4O4q2eSwlJg== 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2023-08-10T10:28:36.669 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkY9LqFhAAAyKC8/QvBdbxxDEa4AfnhA== 2023-08-10T10:28:36.670 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-08-10T10:28:36.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9Rk7BBHGhAAHHH/tOnTr1GVl8+INqvDZw== 2023-08-10T10:28:36.670 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2023-08-10T10:28:36.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9Rk63G7HRAA31xKSf623Ix72EDYgTE4Pg== 2023-08-10T10:28:36.687 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2023-08-10T10:28:36.687 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC0u9RkGrfpLhAArjhcAInUtQEZ/GksarmS0g== 2023-08-10T10:28:36.687 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-08-10T10:28:36.687 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC0u9Rk4hf5NhAABDudX5WuXCUCX6/b5FzeqA== 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9RkWqC2AhAAX+sz3tw1o5AzTnwO/i/00w== 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC4u9RkhrBOKRAA1Gnrlfw347KrNlnZ6EaCkg== 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2023-08-10T10:28:36.688 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC7u9RkM72PKBAAiZL/W/bW7wQof5EqanYSPg== 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC+u9RktHKPJxAAMn6VWWHMiYZKUJSDvtycAQ== 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDBu9RkDFZ9JxAAymZXEREJ56qzs9b54DR1pg== 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC0u9Rk2CWgMxAA5JR8LboZnHWzk7eeUxeHnQ== 2023-08-10T10:28:36.689 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9RkwCzPBxAA5QE5xgkVUH8zLiJ7U/FwfA== 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9RkiXBEDxAAdz/D2bYIQpb/jBLDU2WbmA== 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDHu9Rk5M5oKhAAz4oHySLquHN0ys1M4yFyzw== 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDKu9Rkg+NHKhAArOo8iMCwOXWzXjjVVevbYw== 2023-08-10T10:28:36.690 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDNu9Rko693KRAAtWPCq3ejpC4hncanrCsTbw== 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDQu9Rkk+itKBAA6rbePsSNcKrJes/wJEqq1g== 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9RkxHySExAA2njciOh3wsl4O4q2eSwlJg== 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2023-08-10T10:28:36.691 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9RkY9LqFhAAAyKC8/QvBdbxxDEa4AfnhA== 2023-08-10T10:28:36.692 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2023-08-10T10:28:36.692 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9Rk7BBHGhAAHHH/tOnTr1GVl8+INqvDZw== 2023-08-10T10:28:36.692 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2023-08-10T10:28:36.692 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQC1u9Rk63G7HRAA31xKSf623Ix72EDYgTE4Pg== 2023-08-10T10:28:36.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:28:36.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:28:36.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:36.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:36.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:36.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:36.902 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:36.905 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:36.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:36.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.070 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:28:37.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:28:37.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:37.179 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:37.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:37.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:28:37.292 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.347 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.402 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.456 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.458 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:28:37.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.627 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:28:37.743 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-10T10:28:37.744 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-10T10:28:37.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:28:37.868 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-10T10:28:37.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-10T10:28:37.924 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:28:38.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-10T10:28:38.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-10T10:28:38.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:28:38.216 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-10T10:28:38.241 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:38.244 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:28:38.298 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-10T10:28:38.299 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-10T10:28:38.299 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-10T10:28:38.302 INFO:tasks.ceph.mon.a:Started 2023-08-10T10:28:38.302 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-10T10:28:38.302 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-10T10:28:38.340 INFO:tasks.ceph.mon.b:Started 2023-08-10T10:28:38.341 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-10T10:28:38.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-10T10:28:38.343 INFO:tasks.ceph.mon.c:Started 2023-08-10T10:28:38.343 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-10T10:28:38.344 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-10T10:28:38.344 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-10T10:28:38.346 INFO:tasks.ceph.mgr.y:Started 2023-08-10T10:28:38.346 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-10T10:28:38.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-10T10:28:38.348 INFO:tasks.ceph.mgr.x:Started 2023-08-10T10:28:38.349 INFO:tasks.ceph:Setting crush tunables to default 2023-08-10T10:28:38.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd crush tunables default 2023-08-10T10:28:38.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.471+0000 7fb0db8fe700 1 Processor -- start 2023-08-10T10:28:38.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.471+0000 7fb0db8fe700 1 -- start start 2023-08-10T10:28:38.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d4071950 con 0x7fb0d40cf730 2023-08-10T10:28:38.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40cfb80 con 0x7fb0d40cb9f0 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0db8fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b2660 con 0x7fb0d4160d20 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59124/0 (socket says 172.21.15.161:59124) 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 learned_addr learned my addr 172.21.15.161:0/234451039 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 msgr2=0x7fb0d406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 msgr2=0x7fb0d406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:28:38.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:28:38.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:28:38.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d969a700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d8e99700 1 -- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 msgr2=0x7fb0d40cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d8e99700 1 -- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 msgr2=0x7fb0d40cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d969a700 1 -- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 msgr2=0x7fb0d40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d969a700 1 -- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 msgr2=0x7fb0d40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d969a700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:28:38.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:28:38.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.472+0000 7fb0d969a700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:28:38.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.161:3300/0 conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d969a700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 msgr2=0x7fb0d40cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 msgr2=0x7fb0d40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:38.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 -- 172.21.15.161:0/234451039 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d406dc10 con 0x7fb0d40cf730 2023-08-10T10:28:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d406a190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40b2820 tx=0x7fb0cc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8871ca31acf9f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0cbfff700 1 -- 172.21.15.161:0/234451039 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc003e30 con 0x7fb0d40cf730 2023-08-10T10:28:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0cbfff700 1 -- 172.21.15.161:0/234451039 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc00f040 con 0x7fb0d40cf730 2023-08-10T10:28:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.673+0000 7fb0cbfff700 1 -- 172.21.15.161:0/234451039 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc007af0 con 0x7fb0d40cf730 2023-08-10T10:28:38.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 -- 172.21.15.161:0/234451039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 msgr2=0x7fb0d406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d406a190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40b2820 tx=0x7fb0cc009e40 comp rx=0 tx=0).stop 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 -- 172.21.15.161:0/234451039 shutdown_connections 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d406a190 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/234451039 >> v2:172.21.15.175:3300/0 conn(0x7fb0d40cb9f0 0x7fb0d40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/234451039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d4160d20 0x7fb0d40cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 -- 172.21.15.161:0/234451039 >> 172.21.15.161:0/234451039 conn(0x7fb0d40cc740 msgr2=0x7fb0d40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:38.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 -- 172.21.15.161:0/234451039 shutdown_connections 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.674+0000 7fb0db8fe700 1 -- 172.21.15.161:0/234451039 wait complete. 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.675+0000 7fb0db8fe700 1 Processor -- start 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.675+0000 7fb0db8fe700 1 -- start start 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d40cb9f0 0x7fb0d40c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d4160d20 0x7fb0d40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:38.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c3d30 con 0x7fb0d40cf730 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b32b0 con 0x7fb0d4160d20 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0db8fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c3f60 con 0x7fb0d40cb9f0 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0d8e99700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0d8e99700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59152/0 (socket says 172.21.15.161:59152) 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0d8e99700 1 -- 172.21.15.161:0/658208203 learned_addr learned my addr 172.21.15.161:0/658208203 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0d969a700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d40cb9f0 0x7fb0d40c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.676+0000 7fb0d9e9b700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d4160d20 0x7fb0d40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 -- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d40cb9f0 msgr2=0x7fb0d40c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d40cb9f0 0x7fb0d40c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 -- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d4160d20 msgr2=0x7fb0d40acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d4160d20 0x7fb0d40acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 -- 172.21.15.161:0/658208203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0097c0 con 0x7fb0d40cf730 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0d8e99700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009730 tx=0x7fb0c4009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4014610 con 0x7fb0d40cf730 2023-08-10T10:28:38.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4014770 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d415d0f0 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4014ae0 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d40b2980 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.677+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0c4014c40 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.678+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb0c401dd90 con 0x7fb0d40cf730 2023-08-10T10:28:38.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.678+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40b3420 con 0x7fb0d40cf730 2023-08-10T10:28:38.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.680+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb0c403cb20 con 0x7fb0d40cf730 2023-08-10T10:28:38.763 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:38.763+0000 7f099d641200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:28:38.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.763+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb0d404ecc0 con 0x7fb0d40cf730 2023-08-10T10:28:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.766+0000 7fb0c9ffb700 1 -- 172.21.15.161:0/658208203 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb0c402b070 con 0x7fb0d40cf730 2023-08-10T10:28:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 msgr2=0x7fb0d415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009730 tx=0x7fb0c4009a40 comp rx=0 tx=0).stop 2023-08-10T10:28:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 shutdown_connections 2023-08-10T10:28:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d4160d20 0x7fb0d40acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d40cb9f0 0x7fb0d40c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 --2- 172.21.15.161:0/658208203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d40cf730 0x7fb0d415cbb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 >> 172.21.15.161:0/658208203 conn(0x7fb0d40cc740 msgr2=0x7fb0d4160280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 shutdown_connections 2023-08-10T10:28:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:38.767+0000 7fb0db8fe700 1 -- 172.21.15.161:0/658208203 wait complete. 2023-08-10T10:28:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2023-08-10T10:28:38.776 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:38.776+0000 7f9e4c078200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:28:38.780 INFO:tasks.ceph:check_enable_crimson: False 2023-08-10T10:28:38.781 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-10T10:28:38.781 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:38.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-10T10:28:38.807 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:38.807 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-10T10:28:38.834 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:38.828+0000 7f099d641200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:28:38.847 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:38.845+0000 7f9e4c078200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:28:38.872 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:38.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-10T10:28:38.903 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:38.903+0000 7f099d641200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:28:38.926 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:38.925+0000 7f9e4c078200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:28:38.938 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:28:38.939 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-10T10:28:38.981 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:38.980+0000 7f099d641200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:28:39.006 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:39.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-10T10:28:39.010 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.010+0000 7f9e4c078200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:28:39.033 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:39.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-10T10:28:39.099 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:39.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-10T10:28:39.128 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:39.127+0000 7f099d641200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:28:39.153 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:28:39.153 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-10T10:28:39.154 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.153+0000 7f9e4c078200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:28:39.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new aaf33d21-dcda-4442-b577-25197c77f282 0 2023-08-10T10:28:39.378 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.378+0000 7f40bb3e5700 1 Processor -- start 2023-08-10T10:28:39.379 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.378+0000 7f40bb3e5700 1 -- start start 2023-08-10T10:28:39.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40bb3e5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 0x7f40b40cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40bb3e5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40b40cf730 0x7f40b406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40bb3e5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b40b25b0 con 0x7f40b40cb9f0 2023-08-10T10:28:39.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40bb3e5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b4071950 con 0x7f40b40b2120 2023-08-10T10:28:39.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40bb3e5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b4160b30 con 0x7f40b40cf730 2023-08-10T10:28:39.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9181700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f40b40cb9f0 0x7f40b4160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:50554/0 (socket says 172.21.15.175:50554) 2023-08-10T10:28:39.385 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9181700 1 -- 172.21.15.175:0/2973753362 learned_addr learned my addr 172.21.15.175:0/2973753362 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-08-10T10:28:39.385 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 --2- 172.21.15.175:0/2973753362 >> v2:172.21.15.175:3300/0 conn(0x7f40b40cf730 0x7f40b406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.386 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b8980700 1 --2- 172.21.15.175:0/2973753362 >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 0x7f40b40cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.386 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 -- 172.21.15.175:0/2973753362 >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 msgr2=0x7f40b40cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:39.386 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 --2- 172.21.15.175:0/2973753362 >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 0x7f40b40cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.386 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 -- 172.21.15.175:0/2973753362 >> v1:172.21.15.175:6789/0 conn(0x7f40b40cb9f0 legacy=0x7f40b4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.387 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 -- 172.21.15.175:0/2973753362 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b406dc10 con 0x7f40b40cf730 2023-08-10T10:28:39.387 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b8980700 1 --2- 172.21.15.175:0/2973753362 >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 0x7f40b40cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:28:39.387 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40b9982700 1 --2- 172.21.15.175:0/2973753362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cf730 0x7f40b406a190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40b40af1a0 tx=0x7f40ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf39eb472a4fd4c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.388 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40abfff700 1 -- 172.21.15.175:0/2973753362 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00e070 con 0x7f40b40cf730 2023-08-10T10:28:39.388 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40abfff700 1 -- 172.21.15.175:0/2973753362 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00bbd0 con 0x7f40b40cf730 2023-08-10T10:28:39.388 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.380+0000 7f40abfff700 1 -- 172.21.15.175:0/2973753362 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac012430 con 0x7f40b40cf730 2023-08-10T10:28:39.388 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 -- 172.21.15.175:0/2973753362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cf730 msgr2=0x7f40b406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.389 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/2973753362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cf730 0x7f40b406a190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40b40af1a0 tx=0x7f40ac00b330 comp rx=0 tx=0).stop 2023-08-10T10:28:39.389 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 -- 172.21.15.175:0/2973753362 shutdown_connections 2023-08-10T10:28:39.389 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/2973753362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cf730 0x7f40b406a190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.389 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/2973753362 >> v2:172.21.15.161:3300/0 conn(0x7f40b40b2120 0x7f40b40cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.390 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 -- 172.21.15.175:0/2973753362 >> 172.21.15.175:0/2973753362 conn(0x7f40b40cc740 msgr2=0x7f40b40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.390 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 -- 172.21.15.175:0/2973753362 shutdown_connections 2023-08-10T10:28:39.390 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.381+0000 7f40bb3e5700 1 -- 172.21.15.175:0/2973753362 wait complete. 2023-08-10T10:28:39.390 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 Processor -- start 2023-08-10T10:28:39.390 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 -- start start 2023-08-10T10:28:39.393 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40b2120 0x7f40b4158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 0x7f40b40b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40b4590 con 0x7f40b40b2120 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40b4870 con 0x7f40b40cb9f0 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40bb3e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40b4b50 con 0x7f40b40cf730 2023-08-10T10:28:39.394 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.383+0000 7f40b9982700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b9982700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45476/0 (socket says 172.21.15.175:45476) 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b9982700 1 -- 172.21.15.175:0/4151807507 learned_addr learned my addr 172.21.15.175:0/4151807507 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 0x7f40b40b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b9181700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40b2120 0x7f40b4158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 -- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 msgr2=0x7f40b40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 -- 172.21.15.175:0/4151807507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40b2120 msgr2=0x7f40b4158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.395 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40b2120 0x7f40b4158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 -- 172.21.15.175:0/4151807507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009a70 con 0x7f40b40cb9f0 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b9982700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40b8980700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 0x7f40b40b0220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c7c0 tx=0x7f40a400cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4011800 con 0x7f40b40cb9f0 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4011960 con 0x7f40b40cb9f0 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b40b4e30 con 0x7f40b40cb9f0 2023-08-10T10:28:39.396 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4011cd0 con 0x7f40b40cb9f0 2023-08-10T10:28:39.397 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.384+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b40b5630 con 0x7f40b40cb9f0 2023-08-10T10:28:39.397 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.385+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f40a401a450 con 0x7f40b40cb9f0 2023-08-10T10:28:39.397 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.385+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f40a40186a0 con 0x7f40b40cb9f0 2023-08-10T10:28:39.397 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.385+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b40b5350 con 0x7f40b40cb9f0 2023-08-10T10:28:39.397 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.387+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f40b40b5350 con 0x7f40b40cb9f0 2023-08-10T10:28:39.468 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:39.467+0000 7f099d641200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:28:39.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.471+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aaf33d21-dcda-4442-b577-25197c77f282", "id": 0} v 0) v1 -- 0x7f40b404ecc0 con 0x7f40b40cb9f0 2023-08-10T10:28:39.477 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.476+0000 7f40a9ffb700 1 -- 172.21.15.175:0/4151807507 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aaf33d21-dcda-4442-b577-25197c77f282", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f40a401f060 con 0x7f40b40cb9f0 2023-08-10T10:28:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:0 2023-08-10T10:28:39.479 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 msgr2=0x7f40b40b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.479 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 0x7f40b40b0220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c7c0 tx=0x7f40a400cad0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 shutdown_connections 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b40cf730 0x7f40b40b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40b40b2120 0x7f40b4158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 --2- 172.21.15.175:0/4151807507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b40cb9f0 0x7f40b40b0220 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.477+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 >> 172.21.15.175:0/4151807507 conn(0x7f40b40cc740 msgr2=0x7f40b40acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.480 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.478+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 shutdown_connections 2023-08-10T10:28:39.481 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.478+0000 7f40bb3e5700 1 -- 172.21.15.175:0/4151807507 wait complete. 2023-08-10T10:28:39.485 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.485+0000 7f9e4c078200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:28:39.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9b1d5a01-758b-4785-8334-b36d27d0cd6f 1 2023-08-10T10:28:39.547 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:39.547+0000 7f099d641200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:28:39.560 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.559+0000 7f9e4c078200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:28:39.612 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.611+0000 7f792e047700 1 Processor -- start 2023-08-10T10:28:39.613 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 -- start start 2023-08-10T10:28:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f79280cb9f0 0x7f79280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792806dc10 con 0x7f79280cf730 2023-08-10T10:28:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7928071950 con 0x7f79280cb9f0 2023-08-10T10:28:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.612+0000 7f792e047700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280cfb80 con 0x7f7928160d20 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45482/0 (socket says 172.21.15.175:45482) 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 -- 172.21.15.175:0/3812727009 learned_addr learned my addr 172.21.15.175:0/3812727009 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f79277fe700 1 --2- 172.21.15.175:0/3812727009 >> v2:172.21.15.161:3300/0 conn(0x7f79280cb9f0 0x7f79280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 -- 172.21.15.175:0/3812727009 >> v2:172.21.15.161:3300/0 conn(0x7f79280cb9f0 msgr2=0x7f79280b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 --2- 172.21.15.175:0/3812727009 >> v2:172.21.15.161:3300/0 conn(0x7f79280cb9f0 0x7f79280b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 -- 172.21.15.175:0/3812727009 >> v1:172.21.15.161:6789/0 conn(0x7f79280cf730 legacy=0x7f792806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 -- 172.21.15.175:0/3812727009 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792806dff0 con 0x7f7928160d20 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f7926ffd700 1 --2- 172.21.15.175:0/3812727009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f791c0098f0 tx=0x7f791c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3978e30979544a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f79267fc700 1 -- 172.21.15.175:0/3812727009 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011830 con 0x7f7928160d20 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f79267fc700 1 -- 172.21.15.175:0/3812727009 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c011990 con 0x7f7928160d20 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.613+0000 7f79267fc700 1 -- 172.21.15.175:0/3812727009 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011d20 con 0x7f7928160d20 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 -- 172.21.15.175:0/3812727009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 msgr2=0x7f79280cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 --2- 172.21.15.175:0/3812727009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f791c0098f0 tx=0x7f791c009c00 comp rx=0 tx=0).stop 2023-08-10T10:28:39.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 -- 172.21.15.175:0/3812727009 shutdown_connections 2023-08-10T10:28:39.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 --2- 172.21.15.175:0/3812727009 >> v2:172.21.15.161:3300/0 conn(0x7f79280cb9f0 0x7f79280b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 --2- 172.21.15.175:0/3812727009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7928160d20 0x7f79280cf1f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 -- 172.21.15.175:0/3812727009 >> 172.21.15.175:0/3812727009 conn(0x7f79280cc740 msgr2=0x7f79280ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 -- 172.21.15.175:0/3812727009 shutdown_connections 2023-08-10T10:28:39.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.614+0000 7f792e047700 1 -- 172.21.15.175:0/3812727009 wait complete. 2023-08-10T10:28:39.620 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.616+0000 7f792e047700 1 Processor -- start 2023-08-10T10:28:39.620 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.616+0000 7f792e047700 1 -- start start 2023-08-10T10:28:39.620 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 0x7f79281552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7928160d20 0x7f7928156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281e68f0 con 0x7f79280cb9f0 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281e6bd0 con 0x7f7928160d20 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79281e6eb0 con 0x7f79280cf730 2023-08-10T10:28:39.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45486/0 (socket says 172.21.15.175:45486) 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 -- 172.21.15.175:0/3839514139 learned_addr learned my addr 172.21.15.175:0/3839514139 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7927fff700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7928160d20 0x7f7928156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f79277fe700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 0x7f79281552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 -- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7928160d20 msgr2=0x7f7928156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7928160d20 0x7f7928156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 -- 172.21.15.175:0/3839514139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 msgr2=0x7f79281552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 0x7f79281552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 -- 172.21.15.175:0/3839514139 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009550 con 0x7f79280cf730 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f79277fe700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 0x7f79281552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f7926ffd700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f791c009c40 tx=0x7f791c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c004510 con 0x7f79280cf730 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c0036a0 con 0x7f79280cf730 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.617+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281e7190 con 0x7f79280cf730 2023-08-10T10:28:39.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.618+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c003a30 con 0x7f79280cf730 2023-08-10T10:28:39.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.618+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7928154a50 con 0x7f79280cf730 2023-08-10T10:28:39.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.618+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f791c02d440 con 0x7f79280cf730 2023-08-10T10:28:39.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.618+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f791c01a7d0 con 0x7f79280cf730 2023-08-10T10:28:39.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.618+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7928160b10 con 0x7f79280cf730 2023-08-10T10:28:39.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.621+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7928160b10 con 0x7f79280cf730 2023-08-10T10:28:39.676 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:39.676+0000 7f099d641200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:28:39.695 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.694+0000 7f9e4c078200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:28:39.706 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.706+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9b1d5a01-758b-4785-8334-b36d27d0cd6f", "id": 1} v 0) v1 -- 0x7f792804ecc0 con 0x7f79280cf730 2023-08-10T10:28:39.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.714+0000 7f790ffff700 1 -- 172.21.15.175:0/3839514139 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b1d5a01-758b-4785-8334-b36d27d0cd6f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f791c028070 con 0x7f79280cf730 2023-08-10T10:28:39.715 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-08-10T10:28:39.716 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 msgr2=0x7f79281e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.716 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f791c009c40 tx=0x7f791c004750 comp rx=0 tx=0).stop 2023-08-10T10:28:39.716 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 shutdown_connections 2023-08-10T10:28:39.716 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7928160d20 0x7f7928156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.716 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79280cb9f0 0x7f79281552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.717 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 --2- 172.21.15.175:0/3839514139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79280cf730 0x7f79281e5e30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.717 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 >> 172.21.15.175:0/3839514139 conn(0x7f79280cc740 msgr2=0x7f79280acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.717 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 shutdown_connections 2023-08-10T10:28:39.717 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.715+0000 7f792e047700 1 -- 172.21.15.175:0/3839514139 wait complete. 2023-08-10T10:28:39.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new e76635dd-599e-43cd-bac4-36d074db3e1a 2 2023-08-10T10:28:39.761 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:39.760+0000 7f099d641200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:28:39.776 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:39.775+0000 7f9e4c078200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:28:39.848 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 Processor -- start 2023-08-10T10:28:39.848 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 -- start start 2023-08-10T10:28:39.850 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f429815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.850 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429815abb0 con 0x7f429815a3b0 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429815ae90 con 0x7f42980b1740 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.848+0000 7f429d36a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429815b170 con 0x7f4298159fd0 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f42977fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f42980b1740 0x7f42980cb1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:50580/0 (socket says 172.21.15.175:50580) 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f42977fe700 1 -- 172.21.15.175:0/1801898061 learned_addr learned my addr 172.21.15.175:0/1801898061 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4296ffd700 1 --2- 172.21.15.175:0/1801898061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f429815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4295ffb700 1 -- 172.21.15.175:0/1801898061 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522977681 0 0) 0x7f429815ae90 con 0x7f42980b1740 2023-08-10T10:28:39.851 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4295ffb700 1 -- 172.21.15.175:0/1801898061 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42800057c0 con 0x7f42980b1740 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4296ffd700 1 -- 172.21.15.175:0/1801898061 >> v1:172.21.15.175:6789/0 conn(0x7f42980b1740 legacy=0x7f42980cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4296ffd700 1 -- 172.21.15.175:0/1801898061 >> v1:172.21.15.161:6789/0 conn(0x7f429815a3b0 legacy=0x7f42980cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4296ffd700 1 -- 172.21.15.175:0/1801898061 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980cac90 con 0x7f4298159fd0 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4296ffd700 1 --2- 172.21.15.175:0/1801898061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f429815e4f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f4288009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ebf2d9497be3ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4295ffb700 1 -- 172.21.15.175:0/1801898061 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011830 con 0x7f4298159fd0 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4295ffb700 1 -- 172.21.15.175:0/1801898061 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288011990 con 0x7f4298159fd0 2023-08-10T10:28:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.849+0000 7f4295ffb700 1 -- 172.21.15.175:0/1801898061 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011d20 con 0x7f4298159fd0 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 -- 172.21.15.175:0/1801898061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 msgr2=0x7f429815e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 --2- 172.21.15.175:0/1801898061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f429815e4f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f4288009b80 comp rx=0 tx=0).stop 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 -- 172.21.15.175:0/1801898061 shutdown_connections 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 --2- 172.21.15.175:0/1801898061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f429815e4f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 -- 172.21.15.175:0/1801898061 >> 172.21.15.175:0/1801898061 conn(0x7f42980cc740 msgr2=0x7f42980ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 -- 172.21.15.175:0/1801898061 shutdown_connections 2023-08-10T10:28:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.850+0000 7f429d36a700 1 -- 172.21.15.175:0/1801898061 wait complete. 2023-08-10T10:28:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.851+0000 7f429d36a700 1 Processor -- start 2023-08-10T10:28:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.851+0000 7f429d36a700 1 -- start start 2023-08-10T10:28:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 0x7f42981551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 0x7f42980ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981556f0 con 0x7f42980b1740 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980acf80 con 0x7f429815a3b0 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f429d36a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980ad260 con 0x7f4298159fd0 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42977fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 0x7f42980ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45496/0 (socket says 172.21.15.175:45496) 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 -- 172.21.15.175:0/1407188874 learned_addr learned my addr 172.21.15.175:0/1407188874 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f4296ffd700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 0x7f42981551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 -- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 msgr2=0x7f42980ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 0x7f42980ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 -- 172.21.15.175:0/1407188874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 msgr2=0x7f42981551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 0x7f42981551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42967fc700 1 -- 172.21.15.175:0/1407188874 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880094a0 con 0x7f4298159fd0 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f42977fe700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 0x7f42980ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.852+0000 7f4296ffd700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 0x7f42981551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f42967fc700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c450 tx=0x7f428c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0052d0 con 0x7f4298159fd0 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c005430 con 0x7f4298159fd0 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980ad540 con 0x7f4298159fd0 2023-08-10T10:28:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0038c0 con 0x7f4298159fd0 2023-08-10T10:28:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42980adb00 con 0x7f4298159fd0 2023-08-10T10:28:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f428c003d20 con 0x7f4298159fd0 2023-08-10T10:28:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.853+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f428c011d10 con 0x7f4298159fd0 2023-08-10T10:28:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.854+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429804ecc0 con 0x7f4298159fd0 2023-08-10T10:28:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.856+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f428c017070 con 0x7f4298159fd0 2023-08-10T10:28:39.941 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.940+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e76635dd-599e-43cd-bac4-36d074db3e1a", "id": 2} v 0) v1 -- 0x7f42980c9dc0 con 0x7f4298159fd0 2023-08-10T10:28:39.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.947+0000 7f427f7fe700 1 -- 172.21.15.175:0/1407188874 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e76635dd-599e-43cd-bac4-36d074db3e1a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f428c011590 con 0x7f4298159fd0 2023-08-10T10:28:39.948 INFO:teuthology.orchestra.run.smithi175.stdout:2 2023-08-10T10:28:39.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 msgr2=0x7f42980b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:39.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c450 tx=0x7f428c00c760 comp rx=0 tx=0).stop 2023-08-10T10:28:39.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 shutdown_connections 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f429815a3b0 0x7f42980ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42980b1740 0x7f42981551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 --2- 172.21.15.175:0/1407188874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4298159fd0 0x7f42980b28e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.948+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 >> 172.21.15.175:0/1407188874 conn(0x7f42980cc740 msgr2=0x7f42981562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.949+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 shutdown_connections 2023-08-10T10:28:39.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:39.949+0000 7f429d36a700 1 -- 172.21.15.175:0/1407188874 wait complete. 2023-08-10T10:28:39.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc 3 2023-08-10T10:28:40.122 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.121+0000 7f2daea2a700 1 Processor -- start 2023-08-10T10:28:40.122 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.121+0000 7f2daea2a700 1 -- start start 2023-08-10T10:28:40.123 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2daea2a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2da806a190 0x7f2da806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2daea2a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da806aae0 con 0x7f2da80b2120 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2daea2a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da80b25b0 con 0x7f2da80cb9f0 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2daea2a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da8071950 con 0x7f2da806a190 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da7fff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2da80cb9f0 0x7f2da8160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:50588/0 (socket says 172.21.15.175:50588) 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da7fff700 1 -- 172.21.15.175:0/201550329 learned_addr learned my addr 172.21.15.175:0/201550329 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2dacfc7700 1 --2- 172.21.15.175:0/201550329 >> v2:172.21.15.161:3300/0 conn(0x7f2da806a190 0x7f2da806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.124 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200488064 0 0) 0x7f2da80b25b0 con 0x7f2da80cb9f0 2023-08-10T10:28:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d900035b0 con 0x7f2da80cb9f0 2023-08-10T10:28:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522486177 0 0) 0x7f2da806aae0 con 0x7f2da80b2120 2023-08-10T10:28:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da80b25b0 con 0x7f2da80b2120 2023-08-10T10:28:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2dacfc7700 1 -- 172.21.15.175:0/201550329 >> v1:172.21.15.175:6789/0 conn(0x7f2da80cb9f0 legacy=0x7f2da8160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2dacfc7700 1 -- 172.21.15.175:0/201550329 >> v1:172.21.15.161:6789/0 conn(0x7f2da80b2120 legacy=0x7f2da80cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.122+0000 7f2dacfc7700 1 -- 172.21.15.175:0/201550329 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da806dc10 con 0x7f2da806a190 2023-08-10T10:28:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2dacfc7700 1 --2- 172.21.15.175:0/201550329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da806a190 0x7f2da806a5a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009d90 tx=0x7f2da000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4be67f02e7654e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000e070 con 0x7f2da806a190 2023-08-10T10:28:40.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da000bb20 con 0x7f2da806a190 2023-08-10T10:28:40.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2da6ffd700 1 -- 172.21.15.175:0/201550329 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0012430 con 0x7f2da806a190 2023-08-10T10:28:40.131 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2daea2a700 1 -- 172.21.15.175:0/201550329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da806a190 msgr2=0x7f2da806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.131 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.123+0000 7f2daea2a700 1 --2- 172.21.15.175:0/201550329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da806a190 0x7f2da806a5a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009d90 tx=0x7f2da000b330 comp rx=0 tx=0).stop 2023-08-10T10:28:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.124+0000 7f2daea2a700 1 -- 172.21.15.175:0/201550329 shutdown_connections 2023-08-10T10:28:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.124+0000 7f2daea2a700 1 --2- 172.21.15.175:0/201550329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da806a190 0x7f2da806a5a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.124+0000 7f2daea2a700 1 -- 172.21.15.175:0/201550329 >> 172.21.15.175:0/201550329 conn(0x7f2da80cc740 msgr2=0x7f2da80ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.124+0000 7f2daea2a700 1 -- 172.21.15.175:0/201550329 shutdown_connections 2023-08-10T10:28:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.124+0000 7f2daea2a700 1 -- 172.21.15.175:0/201550329 wait complete. 2023-08-10T10:28:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.125+0000 7f2daea2a700 1 Processor -- start 2023-08-10T10:28:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.125+0000 7f2daea2a700 1 -- start start 2023-08-10T10:28:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da80b2120 0x7f2da81f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2da80cb9f0 0x7f2da81f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8154330 con 0x7f2da80b2120 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c9860 con 0x7f2da806a190 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2daea2a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c9b40 con 0x7f2da80cb9f0 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2dacfc7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2da80cb9f0 0x7f2da81f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48888/0 (socket says 172.21.15.175:48888) 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 -- 172.21.15.175:0/1560161322 learned_addr learned my addr 172.21.15.175:0/1560161322 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da77fe700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da80b2120 0x7f2da81f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 -- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2da80cb9f0 msgr2=0x7f2da81f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2da80cb9f0 0x7f2da81f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 -- 172.21.15.175:0/1560161322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da80b2120 msgr2=0x7f2da81f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da80b2120 0x7f2da81f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 -- 172.21.15.175:0/1560161322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009a70 con 0x7f2da806a190 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da7fff700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c700 tx=0x7f2d9800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.126+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98005d70 con 0x7f2da806a190 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980070d0 con 0x7f2da806a190 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80b3870 con 0x7f2da806a190 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98007460 con 0x7f2da806a190 2023-08-10T10:28:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da80b3e30 con 0x7f2da806a190 2023-08-10T10:28:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d9801c440 con 0x7f2da806a190 2023-08-10T10:28:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.127+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2d98012890 con 0x7f2da806a190 2023-08-10T10:28:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.128+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da8160b10 con 0x7f2da806a190 2023-08-10T10:28:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.130+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2da8160b10 con 0x7f2da806a190 2023-08-10T10:28:40.206 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:40.205+0000 7f9e4c078200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:28:40.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.222+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc", "id": 3} v 0) v1 -- 0x7f2da804ecc0 con 0x7f2da806a190 2023-08-10T10:28:40.231 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:40.230+0000 7f099d641200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:28:40.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.231+0000 7f2da4ff9700 1 -- 172.21.15.175:0/1560161322 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d98017070 con 0x7f2da806a190 2023-08-10T10:28:40.231 INFO:teuthology.orchestra.run.smithi175.stdout:3 2023-08-10T10:28:40.232 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 msgr2=0x7f2da80c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.232 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c700 tx=0x7f2d9800ca10 comp rx=0 tx=0).stop 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 shutdown_connections 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2da80cb9f0 0x7f2da81f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2da806a190 0x7f2da80c6d90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 --2- 172.21.15.175:0/1560161322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2da80b2120 0x7f2da81f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 >> 172.21.15.175:0/1560161322 conn(0x7f2da80cc740 msgr2=0x7f2da815ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 shutdown_connections 2023-08-10T10:28:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.232+0000 7f2daea2a700 1 -- 172.21.15.175:0/1560161322 wait complete. 2023-08-10T10:28:40.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 88a98da4-8342-4142-9d84-a1c44997d251 4 2023-08-10T10:28:40.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.366+0000 7ff074204700 1 Processor -- start 2023-08-10T10:28:40.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.367+0000 7ff074204700 1 -- start start 2023-08-10T10:28:40.372 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff074204700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff06c15ac10 0x7ff06c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.372 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff074204700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.372 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff074204700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0cebe0 con 0x7ff06c15aff0 2023-08-10T10:28:40.372 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff074204700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c071620 con 0x7ff06c15ac10 2023-08-10T10:28:40.373 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff074204700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b25a0 con 0x7ff06c0b1740 2023-08-10T10:28:40.373 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff071fa0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff06c15ac10 0x7ff06c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.373 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff071fa0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff06c15ac10 0x7ff06c0710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48894/0 (socket says 172.21.15.175:48894) 2023-08-10T10:28:40.374 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff071fa0700 1 -- 172.21.15.175:0/2202552661 learned_addr learned my addr 172.21.15.175:0/2202552661 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.374 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.368+0000 7ff0727a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.374 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff071fa0700 1 -- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 msgr2=0x7ff06c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:40.374 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff071fa0700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff071fa0700 1 -- 172.21.15.175:0/2202552661 >> v1:172.21.15.175:6789/0 conn(0x7ff06c15aff0 legacy=0x7ff06c0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff071fa0700 1 -- 172.21.15.175:0/2202552661 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0b1d00 con 0x7ff06c15ac10 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff070f9e700 1 -- 172.21.15.175:0/2202552661 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982513846 0 0) 0x7ff06c0cebe0 con 0x7ff06c15aff0 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff0727a1700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff071fa0700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0710e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098f0 tx=0x7ff068009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50baaf515daebb77 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff070f9e700 1 -- 172.21.15.175:0/2202552661 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011830 con 0x7ff06c15ac10 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff070f9e700 1 -- 172.21.15.175:0/2202552661 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff068011990 con 0x7ff06c15ac10 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.369+0000 7ff070f9e700 1 -- 172.21.15.175:0/2202552661 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011d20 con 0x7ff06c15ac10 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 -- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 msgr2=0x7ff06c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0710e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098f0 tx=0x7ff068009c00 comp rx=0 tx=0).stop 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 -- 172.21.15.175:0/2202552661 shutdown_connections 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.376 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 --2- 172.21.15.175:0/2202552661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0710e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.377 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 -- 172.21.15.175:0/2202552661 >> 172.21.15.175:0/2202552661 conn(0x7ff06c0cc740 msgr2=0x7ff06c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.377 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 -- 172.21.15.175:0/2202552661 shutdown_connections 2023-08-10T10:28:40.377 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.370+0000 7ff074204700 1 -- 172.21.15.175:0/2202552661 wait complete. 2023-08-10T10:28:40.377 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.371+0000 7ff074204700 1 Processor -- start 2023-08-10T10:28:40.377 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.371+0000 7ff074204700 1 -- start start 2023-08-10T10:28:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 0x7ff06c1f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b1540 con 0x7ff06c15aff0 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b4880 con 0x7ff06c15ac10 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff074204700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b3800 con 0x7ff06c0b1740 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff07179f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff07179f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48902/0 (socket says 172.21.15.175:48902) 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff07179f700 1 -- 172.21.15.175:0/2141150189 learned_addr learned my addr 172.21.15.175:0/2141150189 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff0727a1700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 0x7ff06c1f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 -- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 msgr2=0x7ff06c0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 -- 172.21.15.175:0/2141150189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 msgr2=0x7ff06c1f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.381 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 0x7ff06c1f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff071fa0700 1 -- 172.21.15.175:0/2141150189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064009a70 con 0x7ff06c0b1740 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff0727a1700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 0x7ff06c1f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.372+0000 7ff07179f700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff071fa0700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0b0ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff068016000 tx=0x7ff068004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068004400 con 0x7ff06c0b1740 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06801f070 con 0x7ff06c0b1740 2023-08-10T10:28:40.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff074204700 1 -- 172.21.15.175:0/2141150189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068009550 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0680038a0 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff074204700 1 -- 172.21.15.175:0/2141150189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0b3da0 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff068021030 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.373+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff068003d00 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.374+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c04ecc0 con 0x7ff06c0b1740 2023-08-10T10:28:40.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.376+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff068015020 con 0x7ff06c0b1740 2023-08-10T10:28:40.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.470+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "88a98da4-8342-4142-9d84-a1c44997d251", "id": 4} v 0) v1 -- 0x7ff06c0b31f0 con 0x7ff06c0b1740 2023-08-10T10:28:40.478 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.478+0000 7ff0627fc700 1 -- 172.21.15.175:0/2141150189 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88a98da4-8342-4142-9d84-a1c44997d251", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff06801a450 con 0x7ff06c0b1740 2023-08-10T10:28:40.479 INFO:teuthology.orchestra.run.smithi175.stdout:4 2023-08-10T10:28:40.481 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 msgr2=0x7ff06c0b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.481 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0b0ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff068016000 tx=0x7ff068004750 comp rx=0 tx=0).stop 2023-08-10T10:28:40.482 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 shutdown_connections 2023-08-10T10:28:40.482 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff06c15aff0 0x7ff06c1f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.482 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff06c0b1740 0x7ff06c0b0ac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.483 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 --2- 172.21.15.175:0/2141150189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06c15ac10 0x7ff06c0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.483 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 >> 172.21.15.175:0/2141150189 conn(0x7ff06c0cc740 msgr2=0x7ff06c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.483 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 shutdown_connections 2023-08-10T10:28:40.484 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.479+0000 7ff04ffff700 1 -- 172.21.15.175:0/2141150189 wait complete. 2023-08-10T10:28:40.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 35f0689e-ceb6-4f9c-a582-c91e7cedcf02 5 2023-08-10T10:28:40.612 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.612+0000 7f797385a700 1 Processor -- start 2023-08-10T10:28:40.613 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.612+0000 7f797385a700 1 -- start start 2023-08-10T10:28:40.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f797385a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 0x7f796c0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.615 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f797385a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0cead0 con 0x7f796c0cfcd0 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f797385a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0cedb0 con 0x7f796c160910 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f797385a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0cf090 con 0x7f796c0d0210 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7970df5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 0x7f796c0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f79715f6700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f796c160910 0x7f796c0cf5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:50612/0 (socket says 172.21.15.175:50612) 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f79715f6700 1 -- 172.21.15.175:0/437853786 learned_addr learned my addr 172.21.15.175:0/437853786 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7963fff700 1 -- 172.21.15.175:0/437853786 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120911032 0 0) 0x7f796c0cedb0 con 0x7f796c160910 2023-08-10T10:28:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7970df5700 1 -- 172.21.15.175:0/437853786 >> v1:172.21.15.175:6789/0 conn(0x7f796c160910 legacy=0x7f796c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7970df5700 1 -- 172.21.15.175:0/437853786 >> v1:172.21.15.161:6789/0 conn(0x7f796c0cfcd0 legacy=0x7f796c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7970df5700 1 -- 172.21.15.175:0/437853786 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b2c40 con 0x7f796c0d0210 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7970df5700 1 --2- 172.21.15.175:0/437853786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 0x7f796c0d3ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f795c009870 tx=0x7f795c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f197c2e28224bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7963fff700 1 -- 172.21.15.175:0/437853786 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c011830 con 0x7f796c0d0210 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7963fff700 1 -- 172.21.15.175:0/437853786 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c011990 con 0x7f796c0d0210 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.613+0000 7f7963fff700 1 -- 172.21.15.175:0/437853786 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c011d20 con 0x7f796c0d0210 2023-08-10T10:28:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 -- 172.21.15.175:0/437853786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 msgr2=0x7f796c0d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 --2- 172.21.15.175:0/437853786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 0x7f796c0d3ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f795c009870 tx=0x7f795c009b80 comp rx=0 tx=0).stop 2023-08-10T10:28:40.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 -- 172.21.15.175:0/437853786 shutdown_connections 2023-08-10T10:28:40.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 --2- 172.21.15.175:0/437853786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c0d0210 0x7f796c0d3ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.618 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 -- 172.21.15.175:0/437853786 >> 172.21.15.175:0/437853786 conn(0x7f796c0d3080 msgr2=0x7f796c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.619 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 -- 172.21.15.175:0/437853786 shutdown_connections 2023-08-10T10:28:40.619 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.614+0000 7f797385a700 1 -- 172.21.15.175:0/437853786 wait complete. 2023-08-10T10:28:40.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.615+0000 7f797385a700 1 Processor -- start 2023-08-10T10:28:40.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.615+0000 7f797385a700 1 -- start start 2023-08-10T10:28:40.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c0cfcd0 0x7f796c1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 0x7f796c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c7b00 con 0x7f796c0cfcd0 2023-08-10T10:28:40.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ca2f0 con 0x7f796c0c8650 2023-08-10T10:28:40.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f797385a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ca5d0 con 0x7f796c160910 2023-08-10T10:28:40.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7970df5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 0x7f796c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f79715f6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c0cfcd0 0x7f796c1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7970df5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 0x7f796c15b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45532/0 (socket says 172.21.15.175:45532) 2023-08-10T10:28:40.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48916/0 (socket says 172.21.15.175:48916) 2023-08-10T10:28:40.623 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7970df5700 1 -- 172.21.15.175:0/2624173364 learned_addr learned my addr 172.21.15.175:0/2624173364 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 -- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 msgr2=0x7f796c15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 0x7f796c15b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 -- 172.21.15.175:0/2624173364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c0cfcd0 msgr2=0x7f796c1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c0cfcd0 0x7f796c1f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.616+0000 7f7971df7700 1 -- 172.21.15.175:0/2624173364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c0094a0 con 0x7f796c0c8650 2023-08-10T10:28:40.624 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7971df7700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b4b20 tx=0x7f796400ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964003c00 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c0ca8b0 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964003d60 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400a990 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f79640050d0 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0cae70 con 0x7f796c0c8650 2023-08-10T10:28:40.625 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.617+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7964005560 con 0x7f796c0c8650 2023-08-10T10:28:40.626 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.618+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c04ecc0 con 0x7f796c0c8650 2023-08-10T10:28:40.626 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.620+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7964005720 con 0x7f796c0c8650 2023-08-10T10:28:40.750 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.750+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35f0689e-ceb6-4f9c-a582-c91e7cedcf02", "id": 5} v 0) v1 -- 0x7f796c0c99c0 con 0x7f796c0c8650 2023-08-10T10:28:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.761+0000 7f7961ffb700 1 -- 172.21.15.175:0/2624173364 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35f0689e-ceb6-4f9c-a582-c91e7cedcf02", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79640058c0 con 0x7f796c0c8650 2023-08-10T10:28:40.761 INFO:teuthology.orchestra.run.smithi175.stdout:5 2023-08-10T10:28:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.761+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 msgr2=0x7f796c0b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b4b20 tx=0x7f796400ce70 comp rx=0 tx=0).stop 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 shutdown_connections 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c0c8650 0x7f796c0b36e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c0cfcd0 0x7f796c1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 --2- 172.21.15.175:0/2624173364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f796c160910 0x7f796c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 >> 172.21.15.175:0/2624173364 conn(0x7f796c0d3080 msgr2=0x7f796c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.764 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 shutdown_connections 2023-08-10T10:28:40.764 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.762+0000 7f797385a700 1 -- 172.21.15.175:0/2624173364 wait complete. 2023-08-10T10:28:40.770 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:40.769+0000 7f9e4c078200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:28:40.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f880f09d-e243-42c6-b467-70c07ecb7fb1 6 2023-08-10T10:28:40.835 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:40.835+0000 7f099d641200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:28:40.896 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.896+0000 7efceccb8700 1 Processor -- start 2023-08-10T10:28:40.897 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.896+0000 7efceccb8700 1 -- start start 2023-08-10T10:28:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efceccb8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efceccb8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efce806b560 0x7efce80cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efceccb8700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80d0440 con 0x7efce806bcb0 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efceccb8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce80cb5d0 con 0x7efce806b560 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efceccb8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80cb8b0 con 0x7efce80b3c30 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efce806b560 0x7efce80cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce5d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efce806b560 0x7efce80cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48922/0 (socket says 172.21.15.175:48922) 2023-08-10T10:28:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce5d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45538/0 (socket says 172.21.15.175:45538) 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 -- 172.21.15.175:0/4241819819 learned_addr learned my addr 172.21.15.175:0/4241819819 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 -- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 msgr2=0x7efce80d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 -- 172.21.15.175:0/4241819819 >> v1:172.21.15.161:6789/0 conn(0x7efce806bcb0 legacy=0x7efce806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce6d9d700 1 -- 172.21.15.175:0/4241819819 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80cbb90 con 0x7efce806b560 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.897+0000 7efce5d9b700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:40.900 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efce6d9d700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce806b560 0x7efce80cc390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=952d7432e19c144e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efce559a700 1 -- 172.21.15.175:0/4241819819 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000e070 con 0x7efce806b560 2023-08-10T10:28:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efce559a700 1 -- 172.21.15.175:0/4241819819 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000b910 con 0x7efce806b560 2023-08-10T10:28:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efce559a700 1 -- 172.21.15.175:0/4241819819 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000bcc0 con 0x7efce806b560 2023-08-10T10:28:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efceccb8700 1 -- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce806b560 msgr2=0x7efce80cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efceccb8700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce806b560 0x7efce80cc390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce000b330 comp rx=0 tx=0).stop 2023-08-10T10:28:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efceccb8700 1 -- 172.21.15.175:0/4241819819 shutdown_connections 2023-08-10T10:28:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efceccb8700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce806b560 0x7efce80cc390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.898+0000 7efceccb8700 1 --2- 172.21.15.175:0/4241819819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce80b3c30 0x7efce80d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.899+0000 7efceccb8700 1 -- 172.21.15.175:0/4241819819 >> 172.21.15.175:0/4241819819 conn(0x7efce809a140 msgr2=0x7efce80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.899+0000 7efceccb8700 1 -- 172.21.15.175:0/4241819819 shutdown_connections 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.899+0000 7efceccb8700 1 -- 172.21.15.175:0/4241819819 wait complete. 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.900+0000 7efceccb8700 1 Processor -- start 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.900+0000 7efceccb8700 1 -- start start 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce806bcb0 0x7efce81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 0x7efce8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80c5660 con 0x7efce806bcb0 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80c4a50 con 0x7efce80b3c30 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efceccb8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80c4d30 con 0x7efce806b560 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce6d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 0x7efce8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45542/0 (socket says 172.21.15.175:45542) 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 -- 172.21.15.175:0/3715547782 learned_addr learned my addr 172.21.15.175:0/3715547782 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce5d9b700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce806bcb0 0x7efce81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 -- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 msgr2=0x7efce8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 0x7efce8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 -- 172.21.15.175:0/3715547782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce806bcb0 msgr2=0x7efce81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce806bcb0 0x7efce81544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 -- 172.21.15.175:0/3715547782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0094a0 con 0x7efce806b560 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce6d9d700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 0x7efce8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efce659c700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c4e0 tx=0x7efcd800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80052d0 con 0x7efce806b560 2023-08-10T10:28:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8005430 con 0x7efce806b560 2023-08-10T10:28:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.901+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80038c0 con 0x7efce806b560 2023-08-10T10:28:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.902+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce0009b30 con 0x7efce806b560 2023-08-10T10:28:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.902+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce80c52f0 con 0x7efce806b560 2023-08-10T10:28:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.902+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efcd8003d20 con 0x7efce806b560 2023-08-10T10:28:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.902+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efcd8011d60 con 0x7efce806b560 2023-08-10T10:28:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.902+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce804ecc0 con 0x7efce806b560 2023-08-10T10:28:40.910 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.906+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7efcd8017070 con 0x7efce806b560 2023-08-10T10:28:40.927 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:40.926+0000 7f9e4c078200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:28:40.989 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.989+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f880f09d-e243-42c6-b467-70c07ecb7fb1", "id": 6} v 0) v1 -- 0x7efce806ba90 con 0x7efce806b560 2023-08-10T10:28:40.998 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:40.997+0000 7f099d641200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:28:40.999 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.998+0000 7efcd6ffd700 1 -- 172.21.15.175:0/3715547782 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f880f09d-e243-42c6-b467-70c07ecb7fb1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efcd8011590 con 0x7efce806b560 2023-08-10T10:28:40.999 INFO:teuthology.orchestra.run.smithi175.stdout:6 2023-08-10T10:28:41.000 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 msgr2=0x7efce8153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c4e0 tx=0x7efcd800c7f0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 shutdown_connections 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efce80b3c30 0x7efce8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efce806b560 0x7efce8153c30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 --2- 172.21.15.175:0/3715547782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce806bcb0 0x7efce81544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 >> 172.21.15.175:0/3715547782 conn(0x7efce809a140 msgr2=0x7efce80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:41.001 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 shutdown_connections 2023-08-10T10:28:41.002 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:40.999+0000 7efceccb8700 1 -- 172.21.15.175:0/3715547782 wait complete. 2023-08-10T10:28:41.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 07584d09-b2ab-409a-b0f0-d87050bb4974 7 2023-08-10T10:28:41.133 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.133+0000 7fa5d864d700 1 Processor -- start 2023-08-10T10:28:41.134 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.133+0000 7fa5d864d700 1 -- start start 2023-08-10T10:28:41.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5d015e5e0 0x7fa5d00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00ce0d0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d015e9c0 con 0x7fa5d00cdc40 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d864d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00cc1c0 con 0x7fa5d00cb920 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d5be8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d5be8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45548/0 (socket says 172.21.15.175:45548) 2023-08-10T10:28:41.136 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d5be8700 1 -- 172.21.15.175:0/3142063283 learned_addr learned my addr 172.21.15.175:0/3142063283 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48934/0 (socket says 172.21.15.175:48934) 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d63e9700 1 --2- 172.21.15.175:0/3142063283 >> v2:172.21.15.161:3300/0 conn(0x7fa5d015e5e0 0x7fa5d00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 msgr2=0x7fa5d00cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3142063283 >> v2:172.21.15.161:3300/0 conn(0x7fa5d015e5e0 msgr2=0x7fa5d00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3142063283 >> v2:172.21.15.161:3300/0 conn(0x7fa5d015e5e0 0x7fa5d00cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3142063283 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00cc4a0 con 0x7fa5d00cdc40 2023-08-10T10:28:41.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.134+0000 7fa5d5be8700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:41.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5d006dd30 tx=0x7fa5c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81919378f28d9ac7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:41.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d53e7700 1 -- 172.21.15.175:0/3142063283 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800e070 con 0x7fa5d00cdc40 2023-08-10T10:28:41.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d53e7700 1 -- 172.21.15.175:0/3142063283 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800bb20 con 0x7fa5d00cdc40 2023-08-10T10:28:41.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d53e7700 1 -- 172.21.15.175:0/3142063283 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8012430 con 0x7fa5d00cdc40 2023-08-10T10:28:41.140 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 -- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d00cdc40 msgr2=0x7fa5d00ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.140 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5d006dd30 tx=0x7fa5c800b330 comp rx=0 tx=0).stop 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 -- 172.21.15.175:0/3142063283 shutdown_connections 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d00cdc40 0x7fa5d00ce9b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3142063283 >> v2:172.21.15.161:3300/0 conn(0x7fa5d015e5e0 0x7fa5d00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3142063283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cb920 0x7fa5d00cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.135+0000 7fa5d864d700 1 -- 172.21.15.175:0/3142063283 >> 172.21.15.175:0/3142063283 conn(0x7fa5d009a140 msgr2=0x7fa5d00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.136+0000 7fa5d864d700 1 -- 172.21.15.175:0/3142063283 shutdown_connections 2023-08-10T10:28:41.141 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.136+0000 7fa5d864d700 1 -- 172.21.15.175:0/3142063283 wait complete. 2023-08-10T10:28:41.142 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 Processor -- start 2023-08-10T10:28:41.142 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 -- start start 2023-08-10T10:28:41.142 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5d00cb920 0x7fa5d00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00ca380 con 0x7fa5d00cb920 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00ca8b0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.137+0000 7fa5d864d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00ca5d0 con 0x7fa5d00cdc40 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d5be8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d5be8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:45556/0 (socket says 172.21.15.175:45556) 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48940/0 (socket says 172.21.15.175:48940) 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d5be8700 1 -- 172.21.15.175:0/3293907170 learned_addr learned my addr 172.21.15.175:0/3293907170 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d63e9700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5d00cb920 0x7fa5d00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 msgr2=0x7fa5d0157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3293907170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5d00cb920 msgr2=0x7fa5d00c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5d00cb920 0x7fa5d00c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 -- 172.21.15.175:0/3293907170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009550 con 0x7fa5d015e5e0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d5be8700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d6bea700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8016000 tx=0x7fa5c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8004800 con 0x7fa5d015e5e0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8020070 con 0x7fa5d015e5e0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80276c0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c8009a70 con 0x7fa5d015e5e0 2023-08-10T10:28:41.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.138+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00c8cd0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.146 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.139+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5c8027b20 con 0x7fa5d015e5e0 2023-08-10T10:28:41.146 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.139+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa5c8022070 con 0x7fa5d015e5e0 2023-08-10T10:28:41.146 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.139+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d00cc730 con 0x7fa5d015e5e0 2023-08-10T10:28:41.146 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.141+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fa5c802c060 con 0x7fa5d015e5e0 2023-08-10T10:28:41.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.224+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07584d09-b2ab-409a-b0f0-d87050bb4974", "id": 7} v 0) v1 -- 0x7fa5d004ecc0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.232+0000 7fa5c6ffd700 1 -- 172.21.15.175:0/3293907170 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07584d09-b2ab-409a-b0f0-d87050bb4974", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5c80360b0 con 0x7fa5d015e5e0 2023-08-10T10:28:41.233 INFO:teuthology.orchestra.run.smithi175.stdout:7 2023-08-10T10:28:41.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 msgr2=0x7fa5d00b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8016000 tx=0x7fa5c8004ad0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 shutdown_connections 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d015e5e0 0x7fa5d00b5450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5d00cb920 0x7fa5d00c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 --2- 172.21.15.175:0/3293907170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5d00cdc40 0x7fa5d0157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 >> 172.21.15.175:0/3293907170 conn(0x7fa5d009a140 msgr2=0x7fa5d00ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 shutdown_connections 2023-08-10T10:28:41.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-08-10T10:28:41.233+0000 7fa5d864d700 1 -- 172.21.15.175:0/3293907170 wait complete. 2023-08-10T10:28:41.245 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-10T10:28:41.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-10T10:28:41.247 INFO:tasks.ceph.osd.0:Started 2023-08-10T10:28:41.247 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-10T10:28:41.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-10T10:28:41.249 INFO:tasks.ceph.osd.1:Started 2023-08-10T10:28:41.250 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-10T10:28:41.250 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-10T10:28:41.252 INFO:tasks.ceph.osd.2:Started 2023-08-10T10:28:41.252 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-10T10:28:41.252 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-10T10:28:41.254 INFO:tasks.ceph.osd.3:Started 2023-08-10T10:28:41.254 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-10T10:28:41.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-10T10:28:41.256 INFO:tasks.ceph.osd.4:Started 2023-08-10T10:28:41.257 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-10T10:28:41.257 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-10T10:28:41.258 INFO:tasks.ceph.osd.5:Started 2023-08-10T10:28:41.259 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-10T10:28:41.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-10T10:28:41.261 INFO:tasks.ceph.osd.6:Started 2023-08-10T10:28:41.261 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-10T10:28:41.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-10T10:28:41.263 INFO:tasks.ceph.osd.7:Started 2023-08-10T10:28:41.264 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:41.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.414+0000 7f9be0bb4700 1 Processor -- start 2023-08-10T10:28:41.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.414+0000 7f9be0bb4700 1 -- start start 2023-08-10T10:28:41.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9be0bb4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bdc0aea70 0x7f9bdc0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9be0bb4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9bdc071940 0x7f9bdc06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9be0bb4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc0cf6a0 con 0x7f9bdc06a190 2023-08-10T10:28:41.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9be0bb4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bdc06eb80 con 0x7f9bdc0aea70 2023-08-10T10:28:41.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9be0bb4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bdc0af510 con 0x7f9bdc071940 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bdc0aea70 0x7f9bdc0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bdc0aea70 0x7f9bdc0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59182/0 (socket says 172.21.15.161:59182) 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 -- 172.21.15.161:0/1341795930 learned_addr learned my addr 172.21.15.161:0/1341795930 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bdad9d700 1 --2- 172.21.15.161:0/1341795930 >> v2:172.21.15.175:3300/0 conn(0x7f9bdc071940 0x7f9bdc06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 -- 172.21.15.161:0/1341795930 >> v2:172.21.15.175:3300/0 conn(0x7f9bdc071940 msgr2=0x7f9bdc06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 --2- 172.21.15.161:0/1341795930 >> v2:172.21.15.175:3300/0 conn(0x7f9bdc071940 0x7f9bdc06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 -- 172.21.15.161:0/1341795930 >> v1:172.21.15.175:6789/0 conn(0x7f9bdc06a190 legacy=0x7f9bdc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.415+0000 7f9bd9d9b700 1 -- 172.21.15.161:0/1341795930 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc06ae60 con 0x7f9bdc0aea70 2023-08-10T10:28:41.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9bd9d9b700 1 --2- 172.21.15.161:0/1341795930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0c6810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc06c330 tx=0x7f9bd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589eac2ecffb3416 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:41.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9bd959a700 1 -- 172.21.15.161:0/1341795930 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0011830 con 0x7f9bdc0aea70 2023-08-10T10:28:41.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9bd959a700 1 -- 172.21.15.161:0/1341795930 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0011990 con 0x7f9bdc0aea70 2023-08-10T10:28:41.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9bd959a700 1 -- 172.21.15.161:0/1341795930 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0011d20 con 0x7f9bdc0aea70 2023-08-10T10:28:41.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 -- 172.21.15.161:0/1341795930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 msgr2=0x7f9bdc0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/1341795930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0c6810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc06c330 tx=0x7f9bd0009bd0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 -- 172.21.15.161:0/1341795930 shutdown_connections 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/1341795930 >> v2:172.21.15.175:3300/0 conn(0x7f9bdc071940 0x7f9bdc06a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/1341795930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0c6810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.416+0000 7f9be0bb4700 1 -- 172.21.15.161:0/1341795930 >> 172.21.15.161:0/1341795930 conn(0x7f9bdc0cfd70 msgr2=0x7f9bdc0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.417+0000 7f9be0bb4700 1 -- 172.21.15.161:0/1341795930 shutdown_connections 2023-08-10T10:28:41.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.417+0000 7f9be0bb4700 1 -- 172.21.15.161:0/1341795930 wait complete. 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.418+0000 7f9be0bb4700 1 Processor -- start 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.418+0000 7f9be0bb4700 1 -- start start 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc06a190 0x7f9bdc141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 0x7f9bdc0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1556c0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc140fe0 con 0x7f9bdc071940 2023-08-10T10:28:41.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc152a50 con 0x7f9bdc06a190 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59190/0 (socket says 172.21.15.161:59190) 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 -- 172.21.15.161:0/921613524 learned_addr learned my addr 172.21.15.161:0/921613524 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bda59c700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc06a190 0x7f9bdc141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bd9d9b700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 0x7f9bdc0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:41.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 -- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc06a190 msgr2=0x7f9bdc141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc06a190 0x7f9bdc141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 -- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 msgr2=0x7f9bdc0ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 0x7f9bdc0ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 -- 172.21.15.161:0/921613524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009550 con 0x7f9bdc0aea70 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bd9d9b700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 0x7f9bdc0ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bdad9d700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400efc0 tx=0x7f9bd400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:41.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4009ea0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd400f040 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc1553e0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4014480 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.419+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc152770 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.420+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9bd40148e0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.420+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9bd4013ab0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.420+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc1522f0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.422+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9bdc1522f0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.492+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bdc0744e0 con 0x7f9bdc0aea70 2023-08-10T10:28:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.493+0000 7f9bcaffd700 1 -- 172.21.15.161:0/921613524 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9bd4018020 con 0x7f9bdc0aea70 2023-08-10T10:28:41.494 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":10,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:41.225985+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:28:41.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 msgr2=0x7f9bdc0adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:41.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400efc0 tx=0x7f9bd400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 shutdown_connections 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bdc0aea70 0x7f9bdc0adb30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc06a190 0x7f9bdc141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 --2- 172.21.15.161:0/921613524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc071940 0x7f9bdc0ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 >> 172.21.15.161:0/921613524 conn(0x7f9bdc0cfd70 msgr2=0x7f9bdc15bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:41.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 shutdown_connections 2023-08-10T10:28:41.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:41.494+0000 7f9be0bb4700 1 -- 172.21.15.161:0/921613524 wait complete. 2023-08-10T10:28:41.509 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-10T10:28:41.509 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-10T10:28:41.657 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:41.656+0000 7f9e4c078200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:28:41.728 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:41.728+0000 7f099d641200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:28:41.734 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:41.733+0000 7f9e4c078200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:28:41.804 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:41.803+0000 7f099d641200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:28:41.870 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T10:28:41.869+0000 7f5ad0237640 -1 Falling back to public interface 2023-08-10T10:28:41.875 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:41.874+0000 7f9e4c078200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:28:41.877 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T10:28:41.876+0000 7fbfe568c640 -1 Falling back to public interface 2023-08-10T10:28:41.878 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T10:28:41.878+0000 7ff66321e640 -1 Falling back to public interface 2023-08-10T10:28:41.881 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T10:28:41.881+0000 7f70023a1640 -1 Falling back to public interface 2023-08-10T10:28:41.882 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T10:28:41.881+0000 7fa611d82640 -1 Falling back to public interface 2023-08-10T10:28:41.882 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T10:28:41.881+0000 7f6ff975f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-08-10T10:28:41.885 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T10:28:41.884+0000 7f91dc6e5640 -1 Falling back to public interface 2023-08-10T10:28:41.895 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T10:28:41.894+0000 7fd96aaa8640 -1 Falling back to public interface 2023-08-10T10:28:41.899 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T10:28:41.899+0000 7f6096116640 -1 Falling back to public interface 2023-08-10T10:28:41.948 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:41.948+0000 7f099d641200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:28:42.113 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.112+0000 7f9e4c078200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:28:42.180 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:42.179+0000 7f099d641200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:28:42.188 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.188+0000 7f9e4c078200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:28:42.254 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:42.253+0000 7f099d641200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:28:42.315 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:42.430 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.429+0000 7f6f390ed700 1 Processor -- start 2023-08-10T10:28:42.431 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.429+0000 7f6f390ed700 1 -- start start 2023-08-10T10:28:42.432 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f3415b050 0x7f6f340d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f340cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 0x7f6f340ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340ccd40 con 0x7f6f3415b050 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340ce170 con 0x7f6f340cdd20 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.430+0000 7f6f390ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340cc780 con 0x7f6f340d1a40 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f3415b050 0x7f6f340d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.433 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f3415b050 0x7f6f340d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59192/0 (socket says 172.21.15.161:59192) 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 -- 172.21.15.161:0/2195478709 learned_addr learned my addr 172.21.15.161:0/2195478709 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f3359e700 1 --2- 172.21.15.161:0/2195478709 >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 0x7f6f340ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f3259c700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f340cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 -- 172.21.15.161:0/2195478709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 msgr2=0x7f6f340cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f340cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.434 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 -- 172.21.15.161:0/2195478709 >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 msgr2=0x7f6f340ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/2195478709 >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 0x7f6f340ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 -- 172.21.15.161:0/2195478709 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340cca60 con 0x7f6f3415b050 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f3359e700 1 --2- 172.21.15.161:0/2195478709 >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 0x7f6f340ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3415b050 0x7f6f340d1500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f34071d50 tx=0x7f6f28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e18ff363dd36c40 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f31d9b700 1 -- 172.21.15.161:0/2195478709 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28005e30 con 0x7f6f3415b050 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f31d9b700 1 -- 172.21.15.161:0/2195478709 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28004030 con 0x7f6f3415b050 2023-08-10T10:28:42.435 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.431+0000 7f6f31d9b700 1 -- 172.21.15.161:0/2195478709 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f280043e0 con 0x7f6f3415b050 2023-08-10T10:28:42.438 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 -- 172.21.15.161:0/2195478709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3415b050 msgr2=0x7f6f340d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:42.438 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3415b050 0x7f6f340d1500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f34071d50 tx=0x7f6f28009bd0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 -- 172.21.15.161:0/2195478709 shutdown_connections 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 --2- 172.21.15.161:0/2195478709 >> v2:172.21.15.175:3300/0 conn(0x7f6f340cdd20 0x7f6f340ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3415b050 0x7f6f340d1500 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 --2- 172.21.15.161:0/2195478709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f340cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 -- 172.21.15.161:0/2195478709 >> 172.21.15.161:0/2195478709 conn(0x7f6f3409a150 msgr2=0x7f6f340d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 -- 172.21.15.161:0/2195478709 shutdown_connections 2023-08-10T10:28:42.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.432+0000 7f6f390ed700 1 -- 172.21.15.161:0/2195478709 wait complete. 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 Processor -- start 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 -- start start 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f3415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3415b050 0x7f6f3414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34150140 con 0x7f6f340cdd20 2023-08-10T10:28:42.440 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415cc10 con 0x7f6f3415b050 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.434+0000 7f6f390ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c8f90 con 0x7f6f340d1a40 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59198/0 (socket says 172.21.15.161:59198) 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 -- 172.21.15.161:0/4240468576 learned_addr learned my addr 172.21.15.161:0/4240468576 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f3359e700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3415b050 0x7f6f3414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f3259c700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f3415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 -- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 msgr2=0x7f6f3415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:42.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f3415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 -- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3415b050 msgr2=0x7f6f3414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3415b050 0x7f6f3414fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 -- 172.21.15.161:0/4240468576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009500 con 0x7f6f340cdd20 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f32d9d700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009c10 tx=0x7f6f28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28003c30 con 0x7f6f340cdd20 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28003d90 con 0x7f6f340cdd20 2023-08-10T10:28:42.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3415ced0 con 0x7f6f340cdd20 2023-08-10T10:28:42.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2801c640 con 0x7f6f340cdd20 2023-08-10T10:28:42.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3415d490 con 0x7f6f340cdd20 2023-08-10T10:28:42.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f2801caa0 con 0x7f6f340cdd20 2023-08-10T10:28:42.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.435+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6f28011af0 con 0x7f6f340cdd20 2023-08-10T10:28:42.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.436+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3415d620 con 0x7f6f340cdd20 2023-08-10T10:28:42.444 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.438+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6f2802a060 con 0x7f6f340cdd20 2023-08-10T10:28:42.472 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.471+0000 7f9e4c078200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:28:42.509 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.508+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f340744e0 con 0x7f6f340cdd20 2023-08-10T10:28:42.510 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.508+0000 7f6f1b7fe700 1 -- 172.21.15.161:0/4240468576 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6f28034090 con 0x7f6f340cdd20 2023-08-10T10:28:42.510 INFO:teuthology.misc.health.smithi161.stdout: 2023-08-10T10:28:42.510 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:41.225985+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:28:42.511 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 msgr2=0x7f6f340c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:42.511 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009c10 tx=0x7f6f28004750 comp rx=0 tx=0).stop 2023-08-10T10:28:42.511 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 shutdown_connections 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3415b050 0x7f6f3414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f340cdd20 0x7f6f340c88b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 --2- 172.21.15.161:0/4240468576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f340d1a40 0x7f6f3415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 >> 172.21.15.161:0/4240468576 conn(0x7f6f3409a150 msgr2=0x7f6f3406f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 shutdown_connections 2023-08-10T10:28:42.512 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:42.509+0000 7f6f390ed700 1 -- 172.21.15.161:0/4240468576 wait complete. 2023-08-10T10:28:42.521 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-10T10:28:42.526 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:42.526+0000 7f099d641200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:28:42.692 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.691+0000 7f9e4c078200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:28:42.745 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:42.745+0000 7f099d641200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:28:42.847 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.846+0000 7f9e4c078200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:28:42.900 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:42.899+0000 7f099d641200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:28:42.962 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:42.961+0000 7f9e4c078200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:28:43.017 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:43.016+0000 7f099d641200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:28:43.287 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:43.286+0000 7f9e4c078200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:28:43.343 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:43.342+0000 7f099d641200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:28:43.385 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:43.384+0000 7f9e4c078200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:28:43.442 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:43.442+0000 7f099d641200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:28:43.571 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:43.570+0000 7f9e4c078200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:28:43.627 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:43.626+0000 7f099d641200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:28:44.165 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:44.164+0000 7f9e4c078200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:28:44.215 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-08-10T10:28:44.214+0000 7f099d641200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:28:45.189 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:45.188+0000 7f9e0427e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-10T10:28:45.189 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-08-10T10:28:45.188+0000 7f9e0427e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-10T10:28:45.342 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T10:28:45.341+0000 7f5ad0237640 -1 osd.4 0 log_to_monitors true 2023-08-10T10:28:45.380 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T10:28:45.379+0000 7fbfe568c640 -1 osd.3 0 log_to_monitors true 2023-08-10T10:28:45.391 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T10:28:45.390+0000 7f91dc6e5640 -1 osd.0 0 log_to_monitors true 2023-08-10T10:28:45.414 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T10:28:45.414+0000 7ff66321e640 -1 osd.6 0 log_to_monitors true 2023-08-10T10:28:45.429 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T10:28:45.428+0000 7fa611d82640 -1 osd.2 0 log_to_monitors true 2023-08-10T10:28:45.430 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T10:28:45.428+0000 7f70023a1640 -1 osd.1 0 log_to_monitors true 2023-08-10T10:28:45.433 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T10:28:45.433+0000 7fd96aaa8640 -1 osd.7 0 log_to_monitors true 2023-08-10T10:28:45.438 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T10:28:45.438+0000 7f6096116640 -1 osd.5 0 log_to_monitors true 2023-08-10T10:28:49.180 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T10:28:49.179+0000 7f6ff5f58700 -1 osd.1 0 waiting for initial osdmap 2023-08-10T10:28:49.193 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T10:28:49.192+0000 7f6fee333700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.204 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T10:28:49.203+0000 7fa605939700 -1 osd.2 0 waiting for initial osdmap 2023-08-10T10:28:49.227 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T10:28:49.226+0000 7fbfd9243700 -1 osd.3 0 waiting for initial osdmap 2023-08-10T10:28:49.228 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T10:28:49.227+0000 7fa5fdd14700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.228 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T10:28:49.228+0000 7f5ac3dee700 -1 osd.4 0 waiting for initial osdmap 2023-08-10T10:28:49.232 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T10:28:49.231+0000 7f91d029c700 -1 osd.0 0 waiting for initial osdmap 2023-08-10T10:28:49.245 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T10:28:49.244+0000 7fbfd161e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.249 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T10:28:49.245+0000 7f5abc1c9700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.249 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T10:28:49.246+0000 7f6089ccd700 -1 osd.5 0 waiting for initial osdmap 2023-08-10T10:28:49.250 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T10:28:49.245+0000 7fd95e65f700 -1 osd.7 0 waiting for initial osdmap 2023-08-10T10:28:49.250 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T10:28:49.249+0000 7f91c8677700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.258 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T10:28:49.258+0000 7fd956a3a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.262 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T10:28:49.262+0000 7f60820a8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.267 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T10:28:49.267+0000 7ff656dd5700 -1 osd.6 0 waiting for initial osdmap 2023-08-10T10:28:49.285 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T10:28:49.285+0000 7ff64f1b0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:28:49.327 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:49.438 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.437+0000 7fae3f32f700 1 Processor -- start 2023-08-10T10:28:49.439 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.437+0000 7fae3f32f700 1 -- start start 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3f32f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae380aea70 0x7fae380c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3f32f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380cf6a0 con 0x7fae38071940 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3f32f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3806ae60 con 0x7fae3806a190 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3f32f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3806eb80 con 0x7fae380aea70 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3d8cc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fae38071940 0x7fae3806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36316/0 (socket says 172.21.15.161:36316) 2023-08-10T10:28:49.441 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3d8cc700 1 -- 172.21.15.161:0/2139169098 learned_addr learned my addr 172.21.15.161:0/2139169098 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae3c8ca700 1 --2- 172.21.15.161:0/2139169098 >> v2:172.21.15.175:3300/0 conn(0x7fae380aea70 0x7fae380c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550596981 0 0) 0x7fae380cf6a0 con 0x7fae38071940 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.438+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae240035b0 con 0x7fae38071940 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315055666 0 0) 0x7fae3806ae60 con 0x7fae3806a190 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae380cf6a0 con 0x7fae3806a190 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90718414 0 0) 0x7fae240035b0 con 0x7fae38071940 2023-08-10T10:28:49.442 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae3c8ca700 1 -- 172.21.15.161:0/2139169098 >> v1:172.21.15.175:6789/0 conn(0x7fae3806a190 legacy=0x7fae3806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae3c8ca700 1 -- 172.21.15.161:0/2139169098 >> v1:172.21.15.161:6789/0 conn(0x7fae38071940 legacy=0x7fae3806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae3c8ca700 1 -- 172.21.15.161:0/2139169098 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3806e7a0 con 0x7fae380aea70 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae3c8ca700 1 --2- 172.21.15.161:0/2139169098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae380aea70 0x7fae380c6810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae34009840 tx=0x7fae34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a000efb3baf0d5b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300019f0 con 0x7fae380aea70 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34004030 con 0x7fae380aea70 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.439+0000 7fae2ffff700 1 -- 172.21.15.161:0/2139169098 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340043c0 con 0x7fae380aea70 2023-08-10T10:28:49.443 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 -- 172.21.15.161:0/2139169098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae380aea70 msgr2=0x7fae380c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.444 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 --2- 172.21.15.161:0/2139169098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae380aea70 0x7fae380c6810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae34009840 tx=0x7fae34009b50 comp rx=0 tx=0).stop 2023-08-10T10:28:49.444 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 -- 172.21.15.161:0/2139169098 shutdown_connections 2023-08-10T10:28:49.444 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 --2- 172.21.15.161:0/2139169098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae380aea70 0x7fae380c6810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.444 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 -- 172.21.15.161:0/2139169098 >> 172.21.15.161:0/2139169098 conn(0x7fae380cfd70 msgr2=0x7fae380d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:49.445 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 -- 172.21.15.161:0/2139169098 shutdown_connections 2023-08-10T10:28:49.445 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.440+0000 7fae3f32f700 1 -- 172.21.15.161:0/2139169098 wait complete. 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.441+0000 7fae3f32f700 1 Processor -- start 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.441+0000 7fae3f32f700 1 -- start start 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae3806a190 0x7fae38147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae380aea70 0x7fae381444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:49.447 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3806ac80 con 0x7fae38071940 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae381f3c00 con 0x7fae3806a190 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae381f3130 con 0x7fae380aea70 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59314/0 (socket says 172.21.15.161:59314) 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 -- 172.21.15.161:0/552188153 learned_addr learned my addr 172.21.15.161:0/552188153 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3d0cb700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae3806a190 0x7fae38147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:49.448 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3d8cc700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae380aea70 0x7fae381444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 -- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae380aea70 msgr2=0x7fae381444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae380aea70 0x7fae381444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 -- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae3806a190 msgr2=0x7fae38147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae3806a190 0x7fae38147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 -- 172.21.15.161:0/552188153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340094a0 con 0x7fae38071940 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3c8ca700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae3400a010 tx=0x7fae34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:49.449 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34003cf0 con 0x7fae38071940 2023-08-10T10:28:49.450 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3401f070 con 0x7fae38071940 2023-08-10T10:28:49.450 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3815f4a0 con 0x7fae38071940 2023-08-10T10:28:49.450 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.442+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011870 con 0x7fae38071940 2023-08-10T10:28:49.450 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.443+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae381f3640 con 0x7fae38071940 2023-08-10T10:28:49.450 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.444+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae380744e0 con 0x7fae38071940 2023-08-10T10:28:49.451 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.444+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fae340119d0 con 0x7fae38071940 2023-08-10T10:28:49.451 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.444+0000 7fae2dffb700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 0x7fae1c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:49.451 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.444+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fae34021070 con 0x7fae38071940 2023-08-10T10:28:49.451 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.444+0000 7fae3d0cb700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 0x7fae1c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:49.451 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.445+0000 7fae3d0cb700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 0x7fae1c06d140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae28001220 tx=0x7fae28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:49.452 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.449+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae3408be60 con 0x7fae38071940 2023-08-10T10:28:49.639 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.638+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae380cdb30 con 0x7fae38071940 2023-08-10T10:28:49.640 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.639+0000 7fae2dffb700 1 -- 172.21.15.161:0/552188153 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fae34055d20 con 0x7fae38071940 2023-08-10T10:28:49.641 INFO:teuthology.misc.health.smithi161.stdout: 2023-08-10T10:28:49.641 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":12,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:47.189706+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:28:49.642 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.640+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 msgr2=0x7fae1c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.642 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.640+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 0x7fae1c06d140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae28001220 tx=0x7fae28009040 comp rx=0 tx=0).stop 2023-08-10T10:28:49.642 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.640+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 msgr2=0x7fae381f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:49.642 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.640+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae3400a010 tx=0x7fae34004750 comp rx=0 tx=0).stop 2023-08-10T10:28:49.642 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 shutdown_connections 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fae1c06ac80 0x7fae1c06d140 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae380aea70 0x7fae381444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae3806a190 0x7fae38147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 --2- 172.21.15.161:0/552188153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae38071940 0x7fae381f2bf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 >> 172.21.15.161:0/552188153 conn(0x7fae380cfd70 msgr2=0x7fae38160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 shutdown_connections 2023-08-10T10:28:49.643 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:49.641+0000 7fae3f32f700 1 -- 172.21.15.161:0/552188153 wait complete. 2023-08-10T10:28:49.653 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-10T10:28:56.458 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:56.581 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.580+0000 7f42e9231700 1 Processor -- start 2023-08-10T10:28:56.581 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.580+0000 7f42e9231700 1 -- start start 2023-08-10T10:28:56.584 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e9231700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42e40aea70 0x7f42e40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.584 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e9231700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e40cf6a0 con 0x7f42e4071940 2023-08-10T10:28:56.584 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e9231700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e406ae60 con 0x7f42e406a190 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e9231700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e406eb80 con 0x7f42e40aea70 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e359e700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f42e4071940 0x7f42e406a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36550/0 (socket says 172.21.15.161:36550) 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e359e700 1 -- 172.21.15.161:0/3162730221 learned_addr learned my addr 172.21.15.161:0/3162730221 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415622570 0 0) 0x7f42e40cf6a0 con 0x7f42e4071940 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc0035b0 con 0x7f42e4071940 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e259c700 1 --2- 172.21.15.161:0/3162730221 >> v2:172.21.15.175:3300/0 conn(0x7f42e40aea70 0x7f42e40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.585 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649104827 0 0) 0x7f42cc0035b0 con 0x7f42e4071940 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 >> v2:172.21.15.175:3300/0 conn(0x7f42e40aea70 msgr2=0x7f42e40c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 --2- 172.21.15.161:0/3162730221 >> v2:172.21.15.175:3300/0 conn(0x7f42e40aea70 0x7f42e40c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 >> v1:172.21.15.175:6789/0 conn(0x7f42e406a190 legacy=0x7f42e406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e406e7a0 con 0x7f42e4071940 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f42dc0019f0 con 0x7f42e4071940 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 >> v1:172.21.15.161:6789/0 conn(0x7f42e4071940 legacy=0x7f42e406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.586 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42cc003a00 0x7f42cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42cc004850 0x7f42cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406eb80 con 0x7f42cc005210 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c0b0 con 0x7f42cc004850 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.581+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c270 con 0x7f42cc003a00 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.587 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e259c700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42cc004850 0x7f42cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e2d9d700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42cc003a00 0x7f42cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 -- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42cc003a00 msgr2=0x7f42cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42cc003a00 0x7f42cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 -- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42cc004850 msgr2=0x7f42cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42cc004850 0x7f42cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.588 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 -- 172.21.15.161:0/3162730221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0035b0 con 0x7f42cc005210 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e259c700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42cc004850 0x7f42cc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 -- 172.21.15.161:0/3162730221 reap_dead start 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e359e700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42cc00ba10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a830 tx=0x7f42cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a696eb9fe23572ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00a2f0 con 0x7f42cc005210 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc012600 con 0x7f42cc005210 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.582+0000 7f42e1d9b700 1 -- 172.21.15.161:0/3162730221 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0129b0 con 0x7f42cc005210 2023-08-10T10:28:56.589 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 -- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 msgr2=0x7f42cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42cc00ba10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a830 tx=0x7f42cc005880 comp rx=0 tx=0).stop 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 -- 172.21.15.161:0/3162730221 shutdown_connections 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 --2- 172.21.15.161:0/3162730221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42cc00ba10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 -- 172.21.15.161:0/3162730221 >> 172.21.15.161:0/3162730221 conn(0x7f42e40cfd70 msgr2=0x7f42e40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 -- 172.21.15.161:0/3162730221 shutdown_connections 2023-08-10T10:28:56.590 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.583+0000 7f42e9231700 1 -- 172.21.15.161:0/3162730221 wait complete. 2023-08-10T10:28:56.592 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.584+0000 7f42e9231700 1 Processor -- start 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.584+0000 7f42e9231700 1 -- start start 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42e41f0020 0x7f42e40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42e40addd0 0x7f42e41f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406ac80 con 0x7f42cc005210 2023-08-10T10:28:56.593 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e415e0d0 con 0x7f42e41f0020 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e9231700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41f3b30 con 0x7f42e40addd0 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e2d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e2d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59552/0 (socket says 172.21.15.161:59552) 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e2d9d700 1 -- 172.21.15.161:0/2283651526 learned_addr learned my addr 172.21.15.161:0/2283651526 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e259c700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42e41f0020 0x7f42e40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.585+0000 7f42e359e700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42e40addd0 0x7f42e41f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.594 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 -- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42e40addd0 msgr2=0x7f42e41f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42e40addd0 0x7f42e41f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 -- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42e41f0020 msgr2=0x7f42e40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42e41f0020 0x7f42e40ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 -- 172.21.15.161:0/2283651526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e415f4a0 con 0x7f42cc005210 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e2d9d700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42d800f7f0 tx=0x7f42d800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8005320 con 0x7f42cc005210 2023-08-10T10:28:56.595 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8005480 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e41f3850 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8006aa0 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.586+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e415fa00 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.587+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e40744e0 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.587+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42d8006c00 con 0x7f42cc005210 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.588+0000 7f42cb7fe700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.596 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.588+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42d80886b0 con 0x7f42cc005210 2023-08-10T10:28:56.597 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.588+0000 7f42e259c700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.597 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.588+0000 7f42e259c700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 0x7f42d006d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42e40aeeb0 tx=0x7f42d4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.597 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.593+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f42d8053ca0 con 0x7f42cc005210 2023-08-10T10:28:56.785 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.784+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42e40cc140 con 0x7f42cc005210 2023-08-10T10:28:56.786 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.784+0000 7f42cb7fe700 1 -- 172.21.15.161:0/2283651526 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f42d80572c0 con 0x7f42cc005210 2023-08-10T10:28:56.786 INFO:teuthology.misc.health.smithi161.stdout: 2023-08-10T10:28:56.786 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":17,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:54.284616+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:28:56.788 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.786+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 msgr2=0x7f42d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.788 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.786+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 0x7f42d006d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42e40aeeb0 tx=0x7f42d4009210 comp rx=0 tx=0).stop 2023-08-10T10:28:56.788 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 msgr2=0x7f42e4160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.788 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42d800f7f0 tx=0x7f42d800fb00 comp rx=0 tx=0).stop 2023-08-10T10:28:56.788 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 shutdown_connections 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42e40addd0 0x7f42e41f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42cc005210 0x7f42e4160200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 --2- 172.21.15.161:0/2283651526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42e41f0020 0x7f42e40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 >> 172.21.15.161:0/2283651526 conn(0x7f42e40cfd70 msgr2=0x7f42e40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 shutdown_connections 2023-08-10T10:28:56.789 INFO:teuthology.misc.health.smithi161.stderr:2023-08-10T10:28:56.787+0000 7f42e9231700 1 -- 172.21.15.161:0/2283651526 wait complete. 2023-08-10T10:28:56.799 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-10T10:28:56.799 INFO:tasks.ceph:Creating RBD pool 2023-08-10T10:28:56.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-10T10:28:56.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.917+0000 7efc785fc700 1 Processor -- start 2023-08-10T10:28:56.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.917+0000 7efc785fc700 1 -- start start 2023-08-10T10:28:56.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc785fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc700b2120 0x7efc700cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc785fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700cf730 0x7efc7006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc785fc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700b25b0 con 0x7efc700cb9f0 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc785fc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc70071950 con 0x7efc700b2120 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc785fc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700cfb60 con 0x7efc700cf730 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.918+0000 7efc75b97700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc700b2120 0x7efc700cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc700b2120 0x7efc700cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58362/0 (socket says 172.21.15.161:58362) 2023-08-10T10:28:56.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 -- 172.21.15.161:0/1591628407 learned_addr learned my addr 172.21.15.161:0/1591628407 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:56.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc76b99700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700cf730 0x7efc7006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 -- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700cf730 msgr2=0x7efc7006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 --2- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700cf730 0x7efc7006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 -- 172.21.15.161:0/1591628407 >> v1:172.21.15.175:6789/0 conn(0x7efc700cb9f0 legacy=0x7efc70160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 -- 172.21.15.161:0/1591628407 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7006dc10 con 0x7efc700b2120 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75b97700 1 --2- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700b2120 0x7efc700cf1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0098f0 tx=0x7efc6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de941efe22d3c7c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75396700 1 -- 172.21.15.161:0/1591628407 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c011830 con 0x7efc700b2120 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75396700 1 -- 172.21.15.161:0/1591628407 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c011990 con 0x7efc700b2120 2023-08-10T10:28:56.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.919+0000 7efc75396700 1 -- 172.21.15.161:0/1591628407 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c011d20 con 0x7efc700b2120 2023-08-10T10:28:56.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 -- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700b2120 msgr2=0x7efc700cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 --2- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700b2120 0x7efc700cf1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0098f0 tx=0x7efc6c009c00 comp rx=0 tx=0).stop 2023-08-10T10:28:56.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 -- 172.21.15.161:0/1591628407 shutdown_connections 2023-08-10T10:28:56.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 --2- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700cf730 0x7efc7006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 --2- 172.21.15.161:0/1591628407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700b2120 0x7efc700cf1f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 -- 172.21.15.161:0/1591628407 >> 172.21.15.161:0/1591628407 conn(0x7efc700cc740 msgr2=0x7efc700ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:56.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 -- 172.21.15.161:0/1591628407 shutdown_connections 2023-08-10T10:28:56.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.920+0000 7efc785fc700 1 -- 172.21.15.161:0/1591628407 wait complete. 2023-08-10T10:28:56.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.921+0000 7efc785fc700 1 Processor -- start 2023-08-10T10:28:56.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.921+0000 7efc785fc700 1 -- start start 2023-08-10T10:28:56.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700b2120 0x7efc701471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700cb9f0 0x7efc7006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc700c3d50 con 0x7efc700cf730 2023-08-10T10:28:56.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc700c3a00 con 0x7efc700cb9f0 2023-08-10T10:28:56.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc785fc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700c7020 con 0x7efc700b2120 2023-08-10T10:28:56.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59568/0 (socket says 172.21.15.161:59568) 2023-08-10T10:28:56.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 -- 172.21.15.161:0/402692434 learned_addr learned my addr 172.21.15.161:0/402692434 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:56.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc75b97700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700cb9f0 0x7efc7006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76398700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700b2120 0x7efc701471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 -- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700b2120 msgr2=0x7efc701471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700b2120 0x7efc701471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 -- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700cb9f0 msgr2=0x7efc7006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:56.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700cb9f0 0x7efc7006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:56.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 -- 172.21.15.161:0/402692434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009550 con 0x7efc700cf730 2023-08-10T10:28:56.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc76b99700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc6800efc0 tx=0x7efc6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.922+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68009ea0 con 0x7efc700cf730 2023-08-10T10:28:56.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.923+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800f040 con 0x7efc700cf730 2023-08-10T10:28:56.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.923+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc700c9600 con 0x7efc700cf730 2023-08-10T10:28:56.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.923+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800ced0 con 0x7efc700cf730 2023-08-10T10:28:56.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.923+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700c9bc0 con 0x7efc700cf730 2023-08-10T10:28:56.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.924+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc700cf550 con 0x7efc700cf730 2023-08-10T10:28:56.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.924+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc68014480 con 0x7efc700cf730 2023-08-10T10:28:56.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.924+0000 7efc66ffd700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 0x7efc5406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:56.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.925+0000 7efc76398700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 0x7efc5406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:56.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.925+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc68089740 con 0x7efc700cf730 2023-08-10T10:28:56.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.925+0000 7efc76398700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 0x7efc5406d1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc600018a0 tx=0x7efc60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:56.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:56.929+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efc68054d30 con 0x7efc700cf730 2023-08-10T10:28:57.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.116+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7efc7004ecc0 con 0x7efc700cf730 2023-08-10T10:28:57.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.295+0000 7efc66ffd700 1 -- 172.21.15.161:0/402692434 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7efc68058350 con 0x7efc700cf730 2023-08-10T10:28:57.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 msgr2=0x7efc5406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 0x7efc5406d1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc600018a0 tx=0x7efc60009040 comp rx=0 tx=0).stop 2023-08-10T10:28:57.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 msgr2=0x7efc7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc6800efc0 tx=0x7efc6800c3a0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 shutdown_connections 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efc5406ad10 0x7efc5406d1d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc700cf730 0x7efc7006d1a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc700b2120 0x7efc701471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 --2- 172.21.15.161:0/402692434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc700cb9f0 0x7efc7006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 >> 172.21.15.161:0/402692434 conn(0x7efc700cc740 msgr2=0x7efc700ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:57.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 shutdown_connections 2023-08-10T10:28:57.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.298+0000 7efc785fc700 1 -- 172.21.15.161:0/402692434 wait complete. 2023-08-10T10:28:57.301 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'rbd' created 2023-08-10T10:28:57.311 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-10T10:28:57.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.433+0000 7f9097712700 1 Processor -- start 2023-08-10T10:28:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.433+0000 7f9097712700 1 -- start start 2023-08-10T10:28:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9097712700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90900c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9097712700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f90900aea70 0x7f909006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9097712700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900cf6a0 con 0x7f9090071940 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9097712700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909006eb80 con 0x7f90900aea70 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9097712700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909006ac80 con 0x7f909006a190 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f90900aea70 0x7f909006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f90900aea70 0x7f909006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59572/0 (socket says 172.21.15.161:59572) 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 -- 172.21.15.161:0/1768426904 learned_addr learned my addr 172.21.15.161:0/1768426904 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f90954ae700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90900c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 -- 172.21.15.161:0/1768426904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 msgr2=0x7f90900c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90900c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.434+0000 7f9094cad700 1 -- 172.21.15.161:0/1768426904 >> v1:172.21.15.175:6789/0 conn(0x7f9090071940 legacy=0x7f909006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9094cad700 1 -- 172.21.15.161:0/1768426904 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909006d260 con 0x7f90900aea70 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9094cad700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90900aea70 0x7f909006cd20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098f0 tx=0x7f908c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5930e573cdbb33c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9087fff700 1 -- 172.21.15.161:0/1768426904 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00b8a0 con 0x7f90900aea70 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9087fff700 1 -- 172.21.15.161:0/1768426904 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c00ba00 con 0x7f90900aea70 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9087fff700 1 -- 172.21.15.161:0/1768426904 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00bd90 con 0x7f90900aea70 2023-08-10T10:28:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 -- 172.21.15.161:0/1768426904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90900aea70 msgr2=0x7f909006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90900aea70 0x7f909006cd20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098f0 tx=0x7f908c009c00 comp rx=0 tx=0).stop 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 -- 172.21.15.161:0/1768426904 shutdown_connections 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90900c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 --2- 172.21.15.161:0/1768426904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90900aea70 0x7f909006cd20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 -- 172.21.15.161:0/1768426904 >> 172.21.15.161:0/1768426904 conn(0x7f90900cfd70 msgr2=0x7f90900d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 -- 172.21.15.161:0/1768426904 shutdown_connections 2023-08-10T10:28:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.435+0000 7f9097712700 1 -- 172.21.15.161:0/1768426904 wait complete. 2023-08-10T10:28:57.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 Processor -- start 2023-08-10T10:28:57.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 -- start start 2023-08-10T10:28:57.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90901f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90900aea70 0x7f9090160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090160680 con 0x7f9090071940 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015dae0 con 0x7f90900aea70 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9097712700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90901f2e50 con 0x7f909006a190 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9094cad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9094cad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59580/0 (socket says 172.21.15.161:59580) 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.437+0000 7f9094cad700 1 -- 172.21.15.161:0/3178414799 learned_addr learned my addr 172.21.15.161:0/3178414799 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f90954ae700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90901f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9095caf700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90900aea70 0x7f9090160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 -- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 msgr2=0x7f90901f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90901f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 -- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90900aea70 msgr2=0x7f9090160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90900aea70 0x7f9090160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 -- 172.21.15.161:0/3178414799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009550 con 0x7f9090071940 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9094cad700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:57.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c004400 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c01f070 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90901528b0 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0038e0 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.438+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90901603a0 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.439+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90900744e0 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.440+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f908c021030 con 0x7f9090071940 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.440+0000 7f9085ffb700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 0x7f907406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:57.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.440+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f908c08a610 con 0x7f9090071940 2023-08-10T10:28:57.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.440+0000 7f90954ae700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 0x7f907406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:57.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.440+0000 7f90954ae700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 0x7f907406d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9080009770 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:57.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.445+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f908c055bd0 con 0x7f9090071940 2023-08-10T10:28:57.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:57.633+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90900cdea0 con 0x7f9090071940 2023-08-10T10:28:58.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.296+0000 7f9085ffb700 1 -- 172.21.15.161:0/3178414799 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f908c0591f0 con 0x7f9090071940 2023-08-10T10:28:58.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.299+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 msgr2=0x7f907406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.299+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 0x7f907406d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9080009770 tx=0x7f9080008040 comp rx=0 tx=0).stop 2023-08-10T10:28:58.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 msgr2=0x7f90901f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c004750 comp rx=0 tx=0).stop 2023-08-10T10:28:58.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 shutdown_connections 2023-08-10T10:28:58.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f907406ace0 0x7f907406d1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90900aea70 0x7f9090160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f909006a190 0x7f90901f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 --2- 172.21.15.161:0/3178414799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9090071940 0x7f90901f5680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 >> 172.21.15.161:0/3178414799 conn(0x7f90900cfd70 msgr2=0x7f909015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:58.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 shutdown_connections 2023-08-10T10:28:58.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.300+0000 7f9097712700 1 -- 172.21.15.161:0/3178414799 wait complete. 2023-08-10T10:28:58.304 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-10T10:28:58.318 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-10T10:28:58.318 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:28:58.319 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:28:58.321 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:28:58.321 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:28:58.321 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:28:58.323 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:28:58.324 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:28:58.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:28:58.326 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:28:58.326 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:28:58.327 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:28:58.329 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:28:58.329 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-10T10:28:58.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:58.405 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-08-10T10:28:58.405 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-08-10T10:28:58.411 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-08-10T10:28:58.411 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-08-10T10:28:58.412 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:28:58.410+0000 7f4410bdc700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-10T10:28:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 Processor -- start 2023-08-10T10:28:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 -- start start 2023-08-10T10:28:58.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84fc0ce640 0x7f84fc0d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84fc0b3160 0x7f84fc0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc160e50 con 0x7f84fc160a70 2023-08-10T10:28:58.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0b2cd0 con 0x7f84fc0ce640 2023-08-10T10:28:58.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f8501621700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0cebb0 con 0x7f84fc0b3160 2023-08-10T10:28:58.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84fc0ce640 0x7f84fc0d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84fc0ce640 0x7f84fc0d1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59612/0 (socket says 172.21.15.161:59612) 2023-08-10T10:28:58.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 -- 172.21.15.161:0/4277417643 learned_addr learned my addr 172.21.15.161:0/4277417643 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:58.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fb7fe700 1 --2- 172.21.15.161:0/4277417643 >> v2:172.21.15.175:3300/0 conn(0x7f84fc0b3160 0x7f84fc0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 -- 172.21.15.161:0/4277417643 >> v2:172.21.15.175:3300/0 conn(0x7f84fc0b3160 msgr2=0x7f84fc0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:58.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 --2- 172.21.15.161:0/4277417643 >> v2:172.21.15.175:3300/0 conn(0x7f84fc0b3160 0x7f84fc0b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 -- 172.21.15.161:0/4277417643 >> v1:172.21.15.175:6789/0 conn(0x7f84fc160a70 legacy=0x7f84fc0d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:58.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 -- 172.21.15.161:0/4277417643 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0cee90 con 0x7f84fc0ce640 2023-08-10T10:28:58.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84fa7fc700 1 --2- 172.21.15.161:0/4277417643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc0ce640 0x7f84fc0d1510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098f0 tx=0x7f84f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc1d7e6b7860916 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84f9ffb700 1 -- 172.21.15.161:0/4277417643 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0004230 con 0x7f84fc0ce640 2023-08-10T10:28:58.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84f9ffb700 1 -- 172.21.15.161:0/4277417643 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0004390 con 0x7f84fc0ce640 2023-08-10T10:28:58.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.463+0000 7f84f9ffb700 1 -- 172.21.15.161:0/4277417643 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00036a0 con 0x7f84fc0ce640 2023-08-10T10:28:58.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 -- 172.21.15.161:0/4277417643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc0ce640 msgr2=0x7f84fc0d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 --2- 172.21.15.161:0/4277417643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc0ce640 0x7f84fc0d1510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098f0 tx=0x7f84f0009c00 comp rx=0 tx=0).stop 2023-08-10T10:28:58.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 -- 172.21.15.161:0/4277417643 shutdown_connections 2023-08-10T10:28:58.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 --2- 172.21.15.161:0/4277417643 >> v2:172.21.15.175:3300/0 conn(0x7f84fc0b3160 0x7f84fc0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 --2- 172.21.15.161:0/4277417643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc0ce640 0x7f84fc0d1510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 -- 172.21.15.161:0/4277417643 >> 172.21.15.161:0/4277417643 conn(0x7f84fc0d3020 msgr2=0x7f84fc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:58.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 -- 172.21.15.161:0/4277417643 shutdown_connections 2023-08-10T10:28:58.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.464+0000 7f8501621700 1 -- 172.21.15.161:0/4277417643 wait complete. 2023-08-10T10:28:58.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.465+0000 7f8501621700 1 Processor -- start 2023-08-10T10:28:58.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.465+0000 7f8501621700 1 -- start start 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0b3160 0x7f84fc1e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc0ce640 0x7f84fc1e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0cb410 con 0x7f84fc160a70 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1591c0 con 0x7f84fc0b3160 2023-08-10T10:28:58.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.466+0000 7f8501621700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1594a0 con 0x7f84fc0ce640 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84faffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0b3160 0x7f84fc1e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59620/0 (socket says 172.21.15.161:59620) 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 -- 172.21.15.161:0/4273655822 learned_addr learned my addr 172.21.15.161:0/4273655822 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fa7fc700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc0ce640 0x7f84fc1e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 -- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc0ce640 msgr2=0x7f84fc1e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc0ce640 0x7f84fc1e7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 -- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0b3160 msgr2=0x7f84fc1e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0b3160 0x7f84fc1e6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 -- 172.21.15.161:0/4273655822 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009550 con 0x7f84fc160a70 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84fb7fe700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84f400cc30 tx=0x7f84f400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400aa50 con 0x7f84fc160a70 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400abb0 con 0x7f84fc160a70 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc159780 con 0x7f84fc160a70 2023-08-10T10:28:58.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4003a20 con 0x7f84fc160a70 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.467+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc0b6310 con 0x7f84fc160a70 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.468+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc0cb580 con 0x7f84fc160a70 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.469+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84f400f3f0 con 0x7f84fc160a70 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.469+0000 7f84e37fe700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 0x7f84e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.469+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f84f40891e0 con 0x7f84fc160a70 2023-08-10T10:28:58.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.469+0000 7f84faffd700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 0x7f84e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.469+0000 7f84faffd700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 0x7f84e806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0b1d90 tx=0x7f84ec007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.474+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f84f40545e0 con 0x7f84fc160a70 2023-08-10T10:28:58.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.664+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84fc0744e0 con 0x7f84fc160a70 2023-08-10T10:28:58.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.665+0000 7f84e37fe700 1 -- 172.21.15.161:0/4273655822 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f84f4057c00 con 0x7f84fc160a70 2023-08-10T10:28:58.666 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:58.666 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":19,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:58.293353+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 msgr2=0x7f84e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 0x7f84e806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0b1d90 tx=0x7f84ec007f10 comp rx=0 tx=0).stop 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 msgr2=0x7f84fc1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84f400cc30 tx=0x7f84f400cf40 comp rx=0 tx=0).stop 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 shutdown_connections 2023-08-10T10:28:58.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84e806ace0 0x7f84e806d1a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84fc160a70 0x7f84fc1581c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0b3160 0x7f84fc1e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 --2- 172.21.15.161:0/4273655822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc0ce640 0x7f84fc1e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.667+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 >> 172.21.15.161:0/4273655822 conn(0x7f84fc0d3020 msgr2=0x7f84fc15deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.668+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 shutdown_connections 2023-08-10T10:28:58.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.668+0000 7f8501621700 1 -- 172.21.15.161:0/4273655822 wait complete. 2023-08-10T10:28:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:28:58.682 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:28:58.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 Processor -- start 2023-08-10T10:28:58.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 -- start start 2023-08-10T10:28:58.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50280cb9f0 0x7f50280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5028160d20 0x7f50280cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502806dc10 con 0x7f50280cf730 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5028071950 con 0x7f5028160d20 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502ed4b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b2660 con 0x7f50280cb9f0 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5028160d20 0x7f50280cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5028160d20 0x7f50280cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59626/0 (socket says 172.21.15.161:59626) 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502d2e8700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f50280cf730 0x7f502806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36634/0 (socket says 172.21.15.161:36634) 2023-08-10T10:28:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 -- 172.21.15.161:0/2464767230 learned_addr learned my addr 172.21.15.161:0/2464767230 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f502cae7700 1 --2- 172.21.15.161:0/2464767230 >> v2:172.21.15.175:3300/0 conn(0x7f50280cb9f0 0x7f50280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 -- 172.21.15.161:0/2464767230 >> v2:172.21.15.175:3300/0 conn(0x7f50280cb9f0 msgr2=0x7f50280b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 --2- 172.21.15.161:0/2464767230 >> v2:172.21.15.175:3300/0 conn(0x7f50280cb9f0 0x7f50280b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 -- 172.21.15.161:0/2464767230 >> v1:172.21.15.161:6789/0 conn(0x7f50280cf730 legacy=0x7f502806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 -- 172.21.15.161:0/2464767230 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502806dff0 con 0x7f5028160d20 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f50277fe700 1 -- 172.21.15.161:0/2464767230 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147123301 0 0) 0x7f502806dc10 con 0x7f50280cf730 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f5027fff700 1 --2- 172.21.15.161:0/2464767230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50280cf1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50280b2820 tx=0x7f5014009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828ea494bb75e1f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f50277fe700 1 -- 172.21.15.161:0/2464767230 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400b870 con 0x7f5028160d20 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f50277fe700 1 -- 172.21.15.161:0/2464767230 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400b9d0 con 0x7f5028160d20 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.805+0000 7f50277fe700 1 -- 172.21.15.161:0/2464767230 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400bd60 con 0x7f5028160d20 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 -- 172.21.15.161:0/2464767230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 msgr2=0x7f50280cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 --2- 172.21.15.161:0/2464767230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50280cf1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50280b2820 tx=0x7f5014009bd0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 -- 172.21.15.161:0/2464767230 shutdown_connections 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 --2- 172.21.15.161:0/2464767230 >> v2:172.21.15.175:3300/0 conn(0x7f50280cb9f0 0x7f50280b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 --2- 172.21.15.161:0/2464767230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50280cf1f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 -- 172.21.15.161:0/2464767230 >> 172.21.15.161:0/2464767230 conn(0x7f50280cc740 msgr2=0x7f50280ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 -- 172.21.15.161:0/2464767230 shutdown_connections 2023-08-10T10:28:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.806+0000 7f502ed4b700 1 -- 172.21.15.161:0/2464767230 wait complete. 2023-08-10T10:28:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.807+0000 7f502ed4b700 1 Processor -- start 2023-08-10T10:28:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.808+0000 7f502ed4b700 1 -- start start 2023-08-10T10:28:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50280cb9f0 0x7f50281f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50280cf730 0x7f50281f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502815eb80 con 0x7f5028160d20 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280b4760 con 0x7f50280cf730 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c3890 con 0x7f50280cb9f0 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59634/0 (socket says 172.21.15.161:59634) 2023-08-10T10:28:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 -- 172.21.15.161:0/3635890835 learned_addr learned my addr 172.21.15.161:0/3635890835 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f5027fff700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50280cf730 0x7f50281f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502cae7700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50280cb9f0 0x7f50281f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 -- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50280cb9f0 msgr2=0x7f50281f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50280cb9f0 0x7f50281f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 -- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50280cf730 msgr2=0x7f50281f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50280cf730 0x7f50281f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 -- 172.21.15.161:0/3635890835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5014009550 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502d2e8700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5020002230 tx=0x7f502000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000ac20 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000ada0 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280c3b70 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020007310 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.809+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280c4130 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.810+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280c4320 con 0x7f5028160d20 2023-08-10T10:28:58.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.811+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5020007470 con 0x7f5028160d20 2023-08-10T10:28:58.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.811+0000 7f50257fa700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 0x7f500c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:58.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.811+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f50200890b0 con 0x7f5028160d20 2023-08-10T10:28:58.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.811+0000 7f502cae7700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 0x7f500c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:58.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.811+0000 7f502cae7700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 0x7f500c06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f501c009770 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:58.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:58.815+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50200544b0 con 0x7f5028160d20 2023-08-10T10:28:59.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.002+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5028160b10 con 0x7f5028160d20 2023-08-10T10:28:59.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.003+0000 7f50257fa700 1 -- 172.21.15.161:0/3635890835 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5020018020 con 0x7f5028160d20 2023-08-10T10:28:59.004 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 msgr2=0x7f500c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 0x7f500c06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f501c009770 tx=0x7f501c008040 comp rx=0 tx=0).stop 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 msgr2=0x7f50281f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5020002230 tx=0x7f502000a060 comp rx=0 tx=0).stop 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 shutdown_connections 2023-08-10T10:28:59.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f500c06ace0 0x7f500c06d1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5028160d20 0x7f50281f57e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50280cb9f0 0x7f50281f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 --2- 172.21.15.161:0/3635890835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50280cf730 0x7f50281f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 >> 172.21.15.161:0/3635890835 conn(0x7f50280cc740 msgr2=0x7f50280ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 shutdown_connections 2023-08-10T10:28:59.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.005+0000 7f502ed4b700 1 -- 172.21.15.161:0/3635890835 wait complete. 2023-08-10T10:28:59.019 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:28:59.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.141+0000 7fc9948ab700 1 Processor -- start 2023-08-10T10:28:59.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.141+0000 7fc9948ab700 1 -- start start 2023-08-10T10:28:59.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc9948ab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc99015e4f0 0x7fc9900cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc9948ab700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9900b1740 0x7fc9900b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc9948ab700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900b20b0 con 0x7fc990159fd0 2023-08-10T10:28:59.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc9948ab700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99015abb0 con 0x7fc9900b1740 2023-08-10T10:28:59.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc9948ab700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99015ae90 con 0x7fc99015e4f0 2023-08-10T10:28:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9900b1740 0x7fc9900b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98e59c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc990159fd0 0x7fc99015a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36644/0 (socket says 172.21.15.161:36644) 2023-08-10T10:28:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98e59c700 1 -- 172.21.15.161:0/3647491453 learned_addr learned my addr 172.21.15.161:0/3647491453 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:28:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 --2- 172.21.15.161:0/3647491453 >> v2:172.21.15.161:3300/0 conn(0x7fc9900b1740 0x7fc9900b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59642/0 (socket says 172.21.15.161:59642) 2023-08-10T10:28:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98dd9b700 1 --2- 172.21.15.161:0/3647491453 >> v2:172.21.15.175:3300/0 conn(0x7fc99015e4f0 0x7fc9900cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 -- 172.21.15.161:0/3647491453 >> v2:172.21.15.175:3300/0 conn(0x7fc99015e4f0 msgr2=0x7fc9900cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 --2- 172.21.15.161:0/3647491453 >> v2:172.21.15.175:3300/0 conn(0x7fc99015e4f0 0x7fc9900cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 -- 172.21.15.161:0/3647491453 >> v1:172.21.15.161:6789/0 conn(0x7fc990159fd0 legacy=0x7fc99015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98ed9d700 1 -- 172.21.15.161:0/3647491453 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99015b170 con 0x7fc9900b1740 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.142+0000 7fc98d59a700 1 -- 172.21.15.161:0/3647491453 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923928796 0 0) 0x7fc9900b20b0 con 0x7fc990159fd0 2023-08-10T10:28:59.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc98ed9d700 1 --2- 172.21.15.161:0/3647491453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9900b1740 0x7fc9900b1b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9900b5bf0 tx=0x7fc98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927971bbfc507622 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc98d59a700 1 -- 172.21.15.161:0/3647491453 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800e070 con 0x7fc9900b1740 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc98d59a700 1 -- 172.21.15.161:0/3647491453 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800bb20 con 0x7fc9900b1740 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc98d59a700 1 -- 172.21.15.161:0/3647491453 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988012430 con 0x7fc9900b1740 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 -- 172.21.15.161:0/3647491453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9900b1740 msgr2=0x7fc9900b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 --2- 172.21.15.161:0/3647491453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9900b1740 0x7fc9900b1b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9900b5bf0 tx=0x7fc98800b330 comp rx=0 tx=0).stop 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 -- 172.21.15.161:0/3647491453 shutdown_connections 2023-08-10T10:28:59.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 --2- 172.21.15.161:0/3647491453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9900b1740 0x7fc9900b1b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 --2- 172.21.15.161:0/3647491453 >> v2:172.21.15.175:3300/0 conn(0x7fc99015e4f0 0x7fc9900cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 -- 172.21.15.161:0/3647491453 >> 172.21.15.161:0/3647491453 conn(0x7fc9900cc740 msgr2=0x7fc9900ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 -- 172.21.15.161:0/3647491453 shutdown_connections 2023-08-10T10:28:59.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.143+0000 7fc9948ab700 1 -- 172.21.15.161:0/3647491453 wait complete. 2023-08-10T10:28:59.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.146+0000 7fc9948ab700 1 Processor -- start 2023-08-10T10:28:59.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.146+0000 7fc9948ab700 1 -- start start 2023-08-10T10:28:59.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.146+0000 7fc9948ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9900b1740 0x7fc9900b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.146+0000 7fc9948ab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99015e4f0 0x7fc9900cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900b2060 con 0x7fc990159fd0 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901e3750 con 0x7fc99015e4f0 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901e3a30 con 0x7fc9900b1740 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59646/0 (socket says 172.21.15.161:59646) 2023-08-10T10:28:59.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 -- 172.21.15.161:0/555033569 learned_addr learned my addr 172.21.15.161:0/555033569 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98ed9d700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99015e4f0 0x7fc9900cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98e59c700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9900b1740 0x7fc9900b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 -- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9900b1740 msgr2=0x7fc9900b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9900b1740 0x7fc9900b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 -- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99015e4f0 msgr2=0x7fc9900cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99015e4f0 0x7fc9900cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 -- 172.21.15.161:0/555033569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009a70 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc98dd9b700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e870 tx=0x7fc98000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980009590 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980013680 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9901e3d10 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9800139f0 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.147+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9901e42d0 con 0x7fc990159fd0 2023-08-10T10:28:59.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.148+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99004ecc0 con 0x7fc990159fd0 2023-08-10T10:28:59.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.149+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc980013b50 con 0x7fc990159fd0 2023-08-10T10:28:59.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.149+0000 7fc97effd700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 0x7fc97006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.149+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc980088f60 con 0x7fc990159fd0 2023-08-10T10:28:59.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.149+0000 7fc98e59c700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 0x7fc97006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.150+0000 7fc98e59c700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 0x7fc97006d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc984007fd0 tx=0x7fc984007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.154+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc980057e80 con 0x7fc990159fd0 2023-08-10T10:28:59.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.343+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9900b5c40 con 0x7fc990159fd0 2023-08-10T10:28:59.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.344+0000 7fc97effd700 1 -- 172.21.15.161:0/555033569 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9800170a0 con 0x7fc990159fd0 2023-08-10T10:28:59.344 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:28:59.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 msgr2=0x7fc97006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 0x7fc97006d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc984007fd0 tx=0x7fc984007de0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 msgr2=0x7fc9900c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e870 tx=0x7fc98000eb80 comp rx=0 tx=0).stop 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 shutdown_connections 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc97006ace0 0x7fc97006d1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99015e4f0 0x7fc9900cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9900b1740 0x7fc9900b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 --2- 172.21.15.161:0/555033569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc990159fd0 0x7fc9900c6d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 >> 172.21.15.161:0/555033569 conn(0x7fc9900cc740 msgr2=0x7fc99015a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 shutdown_connections 2023-08-10T10:28:59.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.346+0000 7fc9948ab700 1 -- 172.21.15.161:0/555033569 wait complete. 2023-08-10T10:28:59.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:28:59.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.482+0000 7f3d1c422700 1 Processor -- start 2023-08-10T10:28:59.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.482+0000 7f3d1c422700 1 -- start start 2023-08-10T10:28:59.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d14154620 0x7f3d140717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d14071d10 0x7f3d1406df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 0x7f3d1415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1406e930 con 0x7f3d14154620 2023-08-10T10:28:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140c5890 con 0x7f3d14071d10 2023-08-10T10:28:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1c422700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1415b290 con 0x7f3d1406e480 2023-08-10T10:28:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d14154620 0x7f3d140717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d14154620 0x7f3d140717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59656/0 (socket says 172.21.15.161:59656) 2023-08-10T10:28:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 -- 172.21.15.161:0/2145044976 learned_addr learned my addr 172.21.15.161:0/2145044976 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d199bd700 1 --2- 172.21.15.161:0/2145044976 >> v2:172.21.15.175:3300/0 conn(0x7f3d14071d10 0x7f3d1406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a9bf700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 0x7f3d1415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 -- 172.21.15.161:0/2145044976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 msgr2=0x7f3d1415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 0x7f3d1415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 -- 172.21.15.161:0/2145044976 >> v2:172.21.15.175:3300/0 conn(0x7f3d14071d10 msgr2=0x7f3d1406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/2145044976 >> v2:172.21.15.175:3300/0 conn(0x7f3d14071d10 0x7f3d1406df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a1be700 1 -- 172.21.15.161:0/2145044976 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1415b570 con 0x7f3d14154620 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.483+0000 7f3d1a9bf700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 0x7f3d1415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:28:59.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d14154620 0x7f3d140717d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d140cdf00 tx=0x7f3d04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705f7f2b59afc096 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d191bc700 1 -- 172.21.15.161:0/2145044976 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400b870 con 0x7f3d14154620 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d191bc700 1 -- 172.21.15.161:0/2145044976 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400b9d0 con 0x7f3d14154620 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d191bc700 1 -- 172.21.15.161:0/2145044976 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400bd60 con 0x7f3d14154620 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 -- 172.21.15.161:0/2145044976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d14154620 msgr2=0x7f3d140717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d14154620 0x7f3d140717d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d140cdf00 tx=0x7f3d04009bd0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 -- 172.21.15.161:0/2145044976 shutdown_connections 2023-08-10T10:28:59.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1406e480 0x7f3d1415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 --2- 172.21.15.161:0/2145044976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d14154620 0x7f3d140717d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 --2- 172.21.15.161:0/2145044976 >> v2:172.21.15.175:3300/0 conn(0x7f3d14071d10 0x7f3d1406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 -- 172.21.15.161:0/2145044976 >> 172.21.15.161:0/2145044976 conn(0x7f3d140cfd70 msgr2=0x7f3d140d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 -- 172.21.15.161:0/2145044976 shutdown_connections 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.484+0000 7f3d1c422700 1 -- 172.21.15.161:0/2145044976 wait complete. 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 Processor -- start 2023-08-10T10:28:59.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 -- start start 2023-08-10T10:28:59.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d14071d10 0x7f3d140b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d14154620 0x7f3d14148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1414c390 con 0x7f3d1406e480 2023-08-10T10:28:59.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1414b9c0 con 0x7f3d14071d10 2023-08-10T10:28:59.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1c422700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140b5610 con 0x7f3d14154620 2023-08-10T10:28:59.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1a1be700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1a1be700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59660/0 (socket says 172.21.15.161:59660) 2023-08-10T10:28:59.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.486+0000 7f3d1a1be700 1 -- 172.21.15.161:0/1212560263 learned_addr learned my addr 172.21.15.161:0/1212560263 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:59.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d199bd700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d14071d10 0x7f3d140b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a9bf700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d14154620 0x7f3d14148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 -- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d14154620 msgr2=0x7f3d14148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d14154620 0x7f3d14148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 -- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d14071d10 msgr2=0x7f3d140b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d14071d10 0x7f3d140b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 -- 172.21.15.161:0/1212560263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009550 con 0x7f3d1406e480 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1a1be700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04004520 con 0x7f3d1406e480 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0401e070 con 0x7f3d1406e480 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d14148e60 con 0x7f3d1406e480 2023-08-10T10:28:59.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040038c0 con 0x7f3d1406e480 2023-08-10T10:28:59.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.487+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1414b090 con 0x7f3d1406e480 2023-08-10T10:28:59.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.488+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1414bca0 con 0x7f3d1406e480 2023-08-10T10:28:59.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.488+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d04003a20 con 0x7f3d1406e480 2023-08-10T10:28:59.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.489+0000 7f3d0affd700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 0x7f3cf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.489+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d04020070 con 0x7f3d1406e480 2023-08-10T10:28:59.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.489+0000 7f3d199bd700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 0x7f3cf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.489+0000 7f3d199bd700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 0x7f3cf806d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d14070c00 tx=0x7f3d10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.493+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3d04055b10 con 0x7f3d1406e480 2023-08-10T10:28:59.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.727+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d140744e0 con 0x7f3d1406e480 2023-08-10T10:28:59.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.727+0000 7f3d0affd700 1 -- 172.21.15.161:0/1212560263 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f3d04015de0 con 0x7f3d1406e480 2023-08-10T10:28:59.728 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:28:59.728 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 msgr2=0x7f3cf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 0x7f3cf806d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d14070c00 tx=0x7f3d10008040 comp rx=0 tx=0).stop 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 msgr2=0x7f3d1414be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d04004750 comp rx=0 tx=0).stop 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 shutdown_connections 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3cf806ace0 0x7f3cf806d1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d14154620 0x7f3d14148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d1406e480 0x7f3d1414be50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 --2- 172.21.15.161:0/1212560263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d14071d10 0x7f3d140b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 >> 172.21.15.161:0/1212560263 conn(0x7f3d140cfd70 msgr2=0x7f3d14159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 shutdown_connections 2023-08-10T10:28:59.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.729+0000 7f3d1c422700 1 -- 172.21.15.161:0/1212560263 wait complete. 2023-08-10T10:28:59.732 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 3 2023-08-10T10:28:59.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:28:59.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.861+0000 7fac9311e700 1 Processor -- start 2023-08-10T10:28:59.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.861+0000 7fac9311e700 1 -- start start 2023-08-10T10:28:59.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac8c154620 0x7fac8c0717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c071d10 0x7fac8c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac8c06e480 0x7fac8c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0c5890 con 0x7fac8c06e480 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c06e8c0 con 0x7fac8c154620 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac9311e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c15b290 con 0x7fac8c071d10 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac8c06e480 0x7fac8c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac8c06e480 0x7fac8c15a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59672/0 (socket says 172.21.15.161:59672) 2023-08-10T10:28:59.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 -- 172.21.15.161:0/1192590239 learned_addr learned my addr 172.21.15.161:0/1192590239 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac8bfff700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c071d10 0x7fac8c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac90eba700 1 --2- 172.21.15.161:0/1192590239 >> v2:172.21.15.175:3300/0 conn(0x7fac8c154620 0x7fac8c0717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 -- 172.21.15.161:0/1192590239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c071d10 msgr2=0x7fac8c06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c071d10 0x7fac8c06df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 -- 172.21.15.161:0/1192590239 >> v2:172.21.15.175:3300/0 conn(0x7fac8c154620 msgr2=0x7fac8c0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 --2- 172.21.15.161:0/1192590239 >> v2:172.21.15.175:3300/0 conn(0x7fac8c154620 0x7fac8c0717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 -- 172.21.15.161:0/1192590239 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c15b570 con 0x7fac8c06e480 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac916bb700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c15a5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0671c0 tx=0x7fac8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f71d57af73fff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac8b7fe700 1 -- 172.21.15.161:0/1192590239 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400e070 con 0x7fac8c06e480 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac8b7fe700 1 -- 172.21.15.161:0/1192590239 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8400b9c0 con 0x7fac8c06e480 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.862+0000 7fac8b7fe700 1 -- 172.21.15.161:0/1192590239 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400bd70 con 0x7fac8c06e480 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 -- 172.21.15.161:0/1192590239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 msgr2=0x7fac8c15a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c15a5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0671c0 tx=0x7fac8400b330 comp rx=0 tx=0).stop 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 -- 172.21.15.161:0/1192590239 shutdown_connections 2023-08-10T10:28:59.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c15a5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 --2- 172.21.15.161:0/1192590239 >> v2:172.21.15.175:3300/0 conn(0x7fac8c154620 0x7fac8c0717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 --2- 172.21.15.161:0/1192590239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c071d10 0x7fac8c06df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 -- 172.21.15.161:0/1192590239 >> 172.21.15.161:0/1192590239 conn(0x7fac8c0cfd70 msgr2=0x7fac8c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:28:59.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 -- 172.21.15.161:0/1192590239 shutdown_connections 2023-08-10T10:28:59.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.863+0000 7fac9311e700 1 -- 172.21.15.161:0/1192590239 wait complete. 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.864+0000 7fac9311e700 1 Processor -- start 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.864+0000 7fac9311e700 1 -- start start 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c071d10 0x7fac8c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 0x7fac8c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c150110 con 0x7fac8c06e480 2023-08-10T10:28:59.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c157fe0 con 0x7fac8c071d10 2023-08-10T10:28:59.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac9311e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c1582c0 con 0x7fac8c154620 2023-08-10T10:28:59.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59674/0 (socket says 172.21.15.161:59674) 2023-08-10T10:28:59.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 -- 172.21.15.161:0/1115468978 learned_addr learned my addr 172.21.15.161:0/1115468978 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac8bfff700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c071d10 0x7fac8c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac916bb700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 0x7fac8c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 -- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 msgr2=0x7fac8c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 0x7fac8c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 -- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c071d10 msgr2=0x7fac8c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:28:59.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c071d10 0x7fac8c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac90eba700 1 -- 172.21.15.161:0/1115468978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009b30 con 0x7fac8c06e480 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.865+0000 7fac916bb700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 0x7fac8c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac90eba700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac8000d800 tx=0x7fac8000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800125f0 con 0x7fac8c06e480 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80012750 con 0x7fac8c06e480 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80012b00 con 0x7fac8c06e480 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c1585a0 con 0x7fac8c06e480 2023-08-10T10:28:59.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.866+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c158b60 con 0x7fac8c06e480 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.867+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c158d20 con 0x7fac8c06e480 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.867+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac80012c60 con 0x7fac8c06e480 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.867+0000 7fac897fa700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 0x7fac7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.868+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fac80089430 con 0x7fac8c06e480 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.868+0000 7fac8bfff700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 0x7fac7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:28:59.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.868+0000 7fac8bfff700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 0x7fac7006d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c154e50 tx=0x7fac78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:28:59.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:28:59.872+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac80054830 con 0x7fac8c06e480 2023-08-10T10:29:00.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.060+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac8c158ed0 con 0x7fac8c06e480 2023-08-10T10:29:00.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.061+0000 7fac897fa700 1 -- 172.21.15.161:0/1115468978 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7fac80057e50 con 0x7fac8c06e480 2023-08-10T10:29:00.062 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:00.062 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:28:59.299614+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 msgr2=0x7fac7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 0x7fac7006d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c154e50 tx=0x7fac78008040 comp rx=0 tx=0).stop 2023-08-10T10:29:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 msgr2=0x7fac8c14f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac8000d800 tx=0x7fac8000db10 comp rx=0 tx=0).stop 2023-08-10T10:29:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 shutdown_connections 2023-08-10T10:29:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fac7006ace0 0x7fac7006d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac8c154620 0x7fac8c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c06e480 0x7fac8c14f820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 --2- 172.21.15.161:0/1115468978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c071d10 0x7fac8c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 >> 172.21.15.161:0/1115468978 conn(0x7fac8c0cfd70 msgr2=0x7fac8c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 shutdown_connections 2023-08-10T10:29:00.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.064+0000 7fac9311e700 1 -- 172.21.15.161:0/1115468978 wait complete. 2023-08-10T10:29:00.077 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:00.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:00.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.202+0000 7fd0d2063700 1 Processor -- start 2023-08-10T10:29:00.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.202+0000 7fd0d2063700 1 -- start start 2023-08-10T10:29:00.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0d2063700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0b2120 0x7fd0cc0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0d2063700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0cc0cf730 0x7fd0cc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0d2063700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc06dc10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0d2063700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc071950 con 0x7fd0cc0cf730 2023-08-10T10:29:00.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0d2063700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0cfb80 con 0x7fd0cc0b2120 2023-08-10T10:29:00.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0cc0cf730 0x7fd0cc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cb7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd0cc0cb9f0 0x7fd0cc160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36688/0 (socket says 172.21.15.161:36688) 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cb7fe700 1 -- 172.21.15.161:0/2249143782 learned_addr learned my addr 172.21.15.161:0/2249143782 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0caffd700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0b2120 0x7fd0cc0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 -- 172.21.15.161:0/2249143782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0b2120 msgr2=0x7fd0cc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0b2120 0x7fd0cc0cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 -- 172.21.15.161:0/2249143782 >> v1:172.21.15.161:6789/0 conn(0x7fd0cc0cb9f0 legacy=0x7fd0cc160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 -- 172.21.15.161:0/2249143782 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc06dff0 con 0x7fd0cc0cf730 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0ca7fc700 1 -- 172.21.15.161:0/2249143782 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085714886 0 0) 0x7fd0cc06dc10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0cbfff700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cf730 0x7fd0cc06a190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009d90 tx=0x7fd0c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c713c325a895f608 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0ca7fc700 1 -- 172.21.15.161:0/2249143782 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400e070 con 0x7fd0cc0cf730 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0ca7fc700 1 -- 172.21.15.161:0/2249143782 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400bbd0 con 0x7fd0cc0cf730 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.203+0000 7fd0ca7fc700 1 -- 172.21.15.161:0/2249143782 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4012430 con 0x7fd0cc0cf730 2023-08-10T10:29:00.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 -- 172.21.15.161:0/2249143782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cf730 msgr2=0x7fd0cc06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cf730 0x7fd0cc06a190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009d90 tx=0x7fd0c400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 -- 172.21.15.161:0/2249143782 shutdown_connections 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cf730 0x7fd0cc06a190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 --2- 172.21.15.161:0/2249143782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0b2120 0x7fd0cc0cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 -- 172.21.15.161:0/2249143782 >> 172.21.15.161:0/2249143782 conn(0x7fd0cc0cc740 msgr2=0x7fd0cc0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 -- 172.21.15.161:0/2249143782 shutdown_connections 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.204+0000 7fd0d2063700 1 -- 172.21.15.161:0/2249143782 wait complete. 2023-08-10T10:29:00.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.206+0000 7fd0d2063700 1 Processor -- start 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.206+0000 7fd0d2063700 1 -- start start 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0cc0b2120 0x7fd0cc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0cf730 0x7fd0cc1f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc1f6a60 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0b2850 con 0x7fd0cc0b2120 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0b2b30 con 0x7fd0cc0cf730 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59690/0 (socket says 172.21.15.161:59690) 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 -- 172.21.15.161:0/3756823001 learned_addr learned my addr 172.21.15.161:0/3756823001 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0cb7fe700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0cc0b2120 0x7fd0cc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0cbfff700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0cf730 0x7fd0cc1f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 -- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0cf730 msgr2=0x7fd0cc1f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0cf730 0x7fd0cc1f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 -- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0cc0b2120 msgr2=0x7fd0cc15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0cc0b2120 0x7fd0cc15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 -- 172.21.15.161:0/3756823001 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009a70 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0caffd700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000d830 tx=0x7fd0c000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00125f0 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0012750 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc1f2e20 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0012b00 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.207+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc1f6f70 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.208+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc160b10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.209+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0c0012c60 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.209+0000 7fd0b3fff700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 0x7fd0b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.209+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd0c00894b0 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.209+0000 7fd0cb7fe700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 0x7fd0b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.210+0000 7fd0cb7fe700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 0x7fd0b806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000f60 tx=0x7fd0bc007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.213+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0cc160b10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.400+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0cc160b10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.401+0000 7fd0b3fff700 1 -- 172.21.15.161:0/3756823001 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0cc160b10 con 0x7fd0cc0cb9f0 2023-08-10T10:29:00.401 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:00.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 msgr2=0x7fd0b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 0x7fd0b806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000f60 tx=0x7fd0bc007c90 comp rx=0 tx=0).stop 2023-08-10T10:29:00.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 msgr2=0x7fd0cc1f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000d830 tx=0x7fd0c000dbf0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 shutdown_connections 2023-08-10T10:29:00.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd0b806ace0 0x7fd0b806d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0cc0cf730 0x7fd0cc1f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0cc0b2120 0x7fd0cc15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 --2- 172.21.15.161:0/3756823001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc0cb9f0 0x7fd0cc1f6520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 >> 172.21.15.161:0/3756823001 conn(0x7fd0cc0cc740 msgr2=0x7fd0cc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 shutdown_connections 2023-08-10T10:29:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.403+0000 7fd0d2063700 1 -- 172.21.15.161:0/3756823001 wait complete. 2023-08-10T10:29:00.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:00.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.539+0000 7f1e1f51a700 1 Processor -- start 2023-08-10T10:29:00.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.539+0000 7f1e1f51a700 1 -- start start 2023-08-10T10:29:00.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1f51a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e180cb9f0 0x7f1e180b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1f51a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e18160d20 0x7f1e180cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1f51a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1806dc10 con 0x7f1e180cf730 2023-08-10T10:29:00.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1f51a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e18071950 con 0x7f1e18160d20 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1f51a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180b2660 con 0x7f1e180cb9f0 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e18160d20 0x7f1e180cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1dab7700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1e180cf730 0x7f1e1806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36706/0 (socket says 172.21.15.161:36706) 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1dab7700 1 -- 172.21.15.161:0/2765852249 learned_addr learned my addr 172.21.15.161:0/2765852249 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1d2b6700 1 --2- 172.21.15.161:0/2765852249 >> v2:172.21.15.175:3300/0 conn(0x7f1e180cb9f0 0x7f1e180b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 -- 172.21.15.161:0/2765852249 >> v2:172.21.15.175:3300/0 conn(0x7f1e180cb9f0 msgr2=0x7f1e180b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:00.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/2765852249 >> v2:172.21.15.175:3300/0 conn(0x7f1e180cb9f0 0x7f1e180b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 -- 172.21.15.161:0/2765852249 >> v1:172.21.15.161:6789/0 conn(0x7f1e180cf730 legacy=0x7f1e1806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 -- 172.21.15.161:0/2765852249 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1806dff0 con 0x7f1e18160d20 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e0ffff700 1 -- 172.21.15.161:0/2765852249 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544538831 0 0) 0x7f1e1806dc10 con 0x7f1e180cf730 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/2765852249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e18160d20 0x7f1e180cf1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e180b2820 tx=0x7f1e08009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17510c0f36d0221 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.540+0000 7f1e0ffff700 1 -- 172.21.15.161:0/2765852249 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08011830 con 0x7f1e18160d20 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e0ffff700 1 -- 172.21.15.161:0/2765852249 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e08011990 con 0x7f1e18160d20 2023-08-10T10:29:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e0ffff700 1 -- 172.21.15.161:0/2765852249 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08011d20 con 0x7f1e18160d20 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 -- 172.21.15.161:0/2765852249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e18160d20 msgr2=0x7f1e180cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/2765852249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e18160d20 0x7f1e180cf1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e180b2820 tx=0x7f1e08009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 -- 172.21.15.161:0/2765852249 shutdown_connections 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/2765852249 >> v2:172.21.15.175:3300/0 conn(0x7f1e180cb9f0 0x7f1e180b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/2765852249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e18160d20 0x7f1e180cf1f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 -- 172.21.15.161:0/2765852249 >> 172.21.15.161:0/2765852249 conn(0x7f1e180cc740 msgr2=0x7f1e180ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 -- 172.21.15.161:0/2765852249 shutdown_connections 2023-08-10T10:29:00.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.541+0000 7f1e1f51a700 1 -- 172.21.15.161:0/2765852249 wait complete. 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.542+0000 7f1e1f51a700 1 Processor -- start 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.542+0000 7f1e1f51a700 1 -- start start 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 0x7f1e181f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e18160d20 0x7f1e181f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1815eb80 con 0x7f1e180cb9f0 2023-08-10T10:29:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180b4760 con 0x7f1e180cf730 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1f51a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c3890 con 0x7f1e18160d20 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59702/0 (socket says 172.21.15.161:59702) 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 -- 172.21.15.161:0/463578024 learned_addr learned my addr 172.21.15.161:0/463578024 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 0x7f1e181f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1dab7700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e18160d20 0x7f1e181f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 -- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e18160d20 msgr2=0x7f1e181f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e18160d20 0x7f1e181f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 -- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 msgr2=0x7f1e181f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 0x7f1e181f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1d2b6700 1 -- 172.21.15.161:0/463578024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080094a0 con 0x7f1e180cb9f0 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.543+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 0x7f1e181f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e1d2b6700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400d800 tx=0x7f1e1400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e140125f0 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e14012750 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14012b00 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180c3b70 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.544+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180c4130 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.545+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18160b10 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.545+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e14012c60 con 0x7f1e180cb9f0 2023-08-10T10:29:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.545+0000 7f1e0dffb700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 0x7f1dfc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.545+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e140894e0 con 0x7f1e180cb9f0 2023-08-10T10:29:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.545+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 0x7f1dfc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.546+0000 7f1e1cab5700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 0x7f1dfc06d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e080090b0 tx=0x7f1e08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.550+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e18160b10 con 0x7f1e180cb9f0 2023-08-10T10:29:00.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.735+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1e18160b10 con 0x7f1e180cb9f0 2023-08-10T10:29:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.735+0000 7f1e0dffb700 1 -- 172.21.15.161:0/463578024 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e18160b10 con 0x7f1e180cb9f0 2023-08-10T10:29:00.736 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:00.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 msgr2=0x7f1dfc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 0x7f1dfc06d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e080090b0 tx=0x7f1e08008030 comp rx=0 tx=0).stop 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 msgr2=0x7f1e181f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400d800 tx=0x7f1e1400dbc0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 shutdown_connections 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1dfc06ace0 0x7f1dfc06d1a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e18160d20 0x7f1e181f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e180cb9f0 0x7f1e181f3a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 --2- 172.21.15.161:0/463578024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e180cf730 0x7f1e181f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 >> 172.21.15.161:0/463578024 conn(0x7f1e180cc740 msgr2=0x7f1e180ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 shutdown_connections 2023-08-10T10:29:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.737+0000 7f1e1f51a700 1 -- 172.21.15.161:0/463578024 wait complete. 2023-08-10T10:29:00.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:29:00.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.869+0000 7fc1f4a27700 1 Processor -- start 2023-08-10T10:29:00.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.869+0000 7fc1f4a27700 1 -- start start 2023-08-10T10:29:00.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.870+0000 7fc1f4a27700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1f01609f0 0x7fc1f00d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.870+0000 7fc1f4a27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f00cd670 0x7fc1f00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.870+0000 7fc1f4a27700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00ce000 con 0x7fc1f0160610 2023-08-10T10:29:00.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.870+0000 7fc1f4a27700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00cbd50 con 0x7fc1f01609f0 2023-08-10T10:29:00.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.870+0000 7fc1f4a27700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00cb440 con 0x7fc1f00cd670 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1eed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f00cd670 0x7fc1f00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1f01609f0 0x7fc1f00d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1ee59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc1f0160610 0x7fc1f00cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:38508/0 (socket says 172.21.15.161:38508) 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1ee59c700 1 -- 172.21.15.161:0/3641495497 learned_addr learned my addr 172.21.15.161:0/3641495497 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 -- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f00cd670 msgr2=0x7fc1f00cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 --2- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f00cd670 0x7fc1f00cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 -- 172.21.15.161:0/3641495497 >> v1:172.21.15.175:6789/0 conn(0x7fc1f0160610 legacy=0x7fc1f00cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1ed59a700 1 -- 172.21.15.161:0/3641495497 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901237740 0 0) 0x7fc1e4001160 con 0x7fc1f0160610 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 -- 172.21.15.161:0/3641495497 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00d0250 con 0x7fc1f01609f0 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1edd9b700 1 --2- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f01609f0 0x7fc1f00d1940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009840 tx=0x7fc1e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56db653460367e5e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.871+0000 7fc1ed59a700 1 -- 172.21.15.161:0/3641495497 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0011830 con 0x7fc1f01609f0 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1ed59a700 1 -- 172.21.15.161:0/3641495497 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0011990 con 0x7fc1f01609f0 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1ed59a700 1 -- 172.21.15.161:0/3641495497 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0011d20 con 0x7fc1f01609f0 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 -- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f01609f0 msgr2=0x7fc1f00d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f01609f0 0x7fc1f00d1940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009840 tx=0x7fc1e0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 -- 172.21.15.161:0/3641495497 shutdown_connections 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f00cd670 0x7fc1f00cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/3641495497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f01609f0 0x7fc1f00d1940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 -- 172.21.15.161:0/3641495497 >> 172.21.15.161:0/3641495497 conn(0x7fc1f009a150 msgr2=0x7fc1f00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 -- 172.21.15.161:0/3641495497 shutdown_connections 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.872+0000 7fc1f4a27700 1 -- 172.21.15.161:0/3641495497 wait complete. 2023-08-10T10:29:00.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.874+0000 7fc1f4a27700 1 Processor -- start 2023-08-10T10:29:00.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.874+0000 7fc1f4a27700 1 -- start start 2023-08-10T10:29:00.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f0160610 0x7fc1f00b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 0x7fc1f00b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00b6010 con 0x7fc1f00cd670 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00b5400 con 0x7fc1f0160610 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1f4a27700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00b56e0 con 0x7fc1f01609f0 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59716/0 (socket says 172.21.15.161:59716) 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 -- 172.21.15.161:0/2609587323 learned_addr learned my addr 172.21.15.161:0/2609587323 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1edd9b700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f0160610 0x7fc1f00b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1eed9d700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 0x7fc1f00b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 -- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 msgr2=0x7fc1f00b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 0x7fc1f00b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 -- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f0160610 msgr2=0x7fc1f00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f0160610 0x7fc1f00b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 -- 172.21.15.161:0/2609587323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00094a0 con 0x7fc1f00cd670 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1eed9d700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 0x7fc1f00b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:00.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.875+0000 7fc1ee59c700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c780 tx=0x7fc1e400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.876+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4004cd0 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.876+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f00b59c0 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.876+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4004e30 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.876+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4007310 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.876+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f01592c0 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.877+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f00b62f0 con 0x7fc1f00cd670 2023-08-10T10:29:00.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.877+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1e4007470 con 0x7fc1f00cd670 2023-08-10T10:29:00.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.877+0000 7fc1deffd700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 0x7fc1d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:00.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.877+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc1e4088ea0 con 0x7fc1f00cd670 2023-08-10T10:29:00.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.877+0000 7fc1edd9b700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 0x7fc1d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:00.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.878+0000 7fc1edd9b700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 0x7fc1d006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00090b0 tx=0x7fc1e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:00.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:00.882+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc1e4054190 con 0x7fc1f00cd670 2023-08-10T10:29:01.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.072+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc1f00ce000 con 0x7fc1f00cd670 2023-08-10T10:29:01.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.072+0000 7fc1deffd700 1 -- 172.21.15.161:0/2609587323 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc1f00ce000 con 0x7fc1f00cd670 2023-08-10T10:29:01.074 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:01.074 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-08-10T10:29:01.074 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:01.075 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-08-10T10:29:01.075 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-08-10T10:29:01.075 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:01.076 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:01.076 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 2, 2023-08-10T10:29:01.076 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": "rbd" 2023-08-10T10:29:01.076 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:01.077 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-08-10T10:29:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 msgr2=0x7fc1d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 0x7fc1d006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00090b0 tx=0x7fc1e001c040 comp rx=0 tx=0).stop 2023-08-10T10:29:01.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 msgr2=0x7fc1f0158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c780 tx=0x7fc1e400cb40 comp rx=0 tx=0).stop 2023-08-10T10:29:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 shutdown_connections 2023-08-10T10:29:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc1d006ace0 0x7fc1d006d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f01609f0 0x7fc1f00b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f00cd670 0x7fc1f0158d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 --2- 172.21.15.161:0/2609587323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f0160610 0x7fc1f00b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 >> 172.21.15.161:0/2609587323 conn(0x7fc1f009a150 msgr2=0x7fc1f015f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:01.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 shutdown_connections 2023-08-10T10:29:01.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.075+0000 7fc1f4a27700 1 -- 172.21.15.161:0/2609587323 wait complete. 2023-08-10T10:29:01.087 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:29:01.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:29:01.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.211+0000 7ff972b36700 1 Processor -- start 2023-08-10T10:29:01.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.211+0000 7ff972b36700 1 -- start start 2023-08-10T10:29:01.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.211+0000 7ff972b36700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff96c06a190 0x7ff96c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.211+0000 7ff972b36700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff96c071940 0x7ff96c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.211+0000 7ff972b36700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0cf6a0 con 0x7ff96c0aea70 2023-08-10T10:29:01.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff972b36700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c06eb80 con 0x7ff96c06a190 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff972b36700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0af510 con 0x7ff96c071940 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff96c06a190 0x7ff96c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff96c06a190 0x7ff96c0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59724/0 (socket says 172.21.15.161:59724) 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 -- 172.21.15.161:0/3899125134 learned_addr learned my addr 172.21.15.161:0/3899125134 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9710d3700 1 --2- 172.21.15.161:0/3899125134 >> v2:172.21.15.175:3300/0 conn(0x7ff96c071940 0x7ff96c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 -- 172.21.15.161:0/3899125134 >> v2:172.21.15.175:3300/0 conn(0x7ff96c071940 msgr2=0x7ff96c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 --2- 172.21.15.161:0/3899125134 >> v2:172.21.15.175:3300/0 conn(0x7ff96c071940 0x7ff96c06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 -- 172.21.15.161:0/3899125134 >> v1:172.21.15.175:6789/0 conn(0x7ff96c0aea70 legacy=0x7ff96c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 -- 172.21.15.161:0/3899125134 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c06ae60 con 0x7ff96c06a190 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff9708d2700 1 --2- 172.21.15.161:0/3899125134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c0c6810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06c330 tx=0x7ff95c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9929da21b0badc7b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff96b7fe700 1 -- 172.21.15.161:0/3899125134 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011830 con 0x7ff96c06a190 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff96b7fe700 1 -- 172.21.15.161:0/3899125134 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c011990 con 0x7ff96c06a190 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.212+0000 7ff96b7fe700 1 -- 172.21.15.161:0/3899125134 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011d20 con 0x7ff96c06a190 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 -- 172.21.15.161:0/3899125134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 msgr2=0x7ff96c0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 --2- 172.21.15.161:0/3899125134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c0c6810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06c330 tx=0x7ff95c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 -- 172.21.15.161:0/3899125134 shutdown_connections 2023-08-10T10:29:01.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 --2- 172.21.15.161:0/3899125134 >> v2:172.21.15.175:3300/0 conn(0x7ff96c071940 0x7ff96c06a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 --2- 172.21.15.161:0/3899125134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c0c6810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 -- 172.21.15.161:0/3899125134 >> 172.21.15.161:0/3899125134 conn(0x7ff96c0cfd70 msgr2=0x7ff96c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:01.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 -- 172.21.15.161:0/3899125134 shutdown_connections 2023-08-10T10:29:01.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.213+0000 7ff972b36700 1 -- 172.21.15.161:0/3899125134 wait complete. 2023-08-10T10:29:01.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.214+0000 7ff972b36700 1 Processor -- start 2023-08-10T10:29:01.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.214+0000 7ff972b36700 1 -- start start 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 0x7ff96c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0aea70 0x7ff96c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c150d00 con 0x7ff96c06a190 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c14f4d0 con 0x7ff96c0aea70 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff972b36700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c14f720 con 0x7ff96c071940 2023-08-10T10:29:01.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59730/0 (socket says 172.21.15.161:59730) 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 -- 172.21.15.161:0/1906978665 learned_addr learned my addr 172.21.15.161:0/1906978665 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9710d3700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0aea70 0x7ff96c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff96bfff700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 0x7ff96c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 -- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 msgr2=0x7ff96c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 0x7ff96c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 -- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0aea70 msgr2=0x7ff96c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0aea70 0x7ff96c0b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff9708d2700 1 -- 172.21.15.161:0/1906978665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009550 con 0x7ff96c06a190 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.215+0000 7ff96bfff700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 0x7ff96c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff9708d2700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009130 tx=0x7ff95c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c004590 con 0x7ff96c06a190 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c01e070 con 0x7ff96c06a190 2023-08-10T10:29:01.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0038c0 con 0x7ff96c06a190 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c14fa00 con 0x7ff96c06a190 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.216+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c14ffc0 con 0x7ff96c06a190 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.217+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0744e0 con 0x7ff96c06a190 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.217+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff95c003a20 con 0x7ff96c06a190 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.218+0000 7ff9697fa700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 0x7ff95806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.218+0000 7ff96bfff700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 0x7ff95806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.218+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff95c089f60 con 0x7ff96c06a190 2023-08-10T10:29:01.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.218+0000 7ff96bfff700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 0x7ff95806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0b1780 tx=0x7ff960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.222+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff95c0553f0 con 0x7ff96c06a190 2023-08-10T10:29:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.409+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff96c06bfa0 con 0x7ff96c06a190 2023-08-10T10:29:01.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.482+0000 7ff9697fa700 1 -- 172.21.15.161:0/1906978665 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff95c020070 con 0x7ff96c06a190 2023-08-10T10:29:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 msgr2=0x7ff95806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 0x7ff95806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0b1780 tx=0x7ff960009040 comp rx=0 tx=0).stop 2023-08-10T10:29:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 msgr2=0x7ff96c1507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009130 tx=0x7ff95c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 shutdown_connections 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff95806ace0 0x7ff95806d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0aea70 0x7ff96c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff96c06a190 0x7ff96c1507c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 --2- 172.21.15.161:0/1906978665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff96c071940 0x7ff96c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 >> 172.21.15.161:0/1906978665 conn(0x7ff96c0cfd70 msgr2=0x7ff96c15b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:01.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 shutdown_connections 2023-08-10T10:29:01.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.486+0000 7ff972b36700 1 -- 172.21.15.161:0/1906978665 wait complete. 2023-08-10T10:29:01.488 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-08-10T10:29:01.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:29:01.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.626+0000 7f832be8a700 1 Processor -- start 2023-08-10T10:29:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.626+0000 7f832be8a700 1 -- start start 2023-08-10T10:29:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832be8a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 0x7f83240cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832be8a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83240b1740 0x7f83240b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832be8a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832415abb0 con 0x7f8324159fd0 2023-08-10T10:29:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832be8a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240b2110 con 0x7f83240b1740 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832be8a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832415ae90 con 0x7f832415e4f0 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83240b1740 0x7f83240b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83240b1740 0x7f83240b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59742/0 (socket says 172.21.15.161:59742) 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 -- 172.21.15.161:0/1522377324 learned_addr learned my addr 172.21.15.161:0/1522377324 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f8329425700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 0x7f83240cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 -- 172.21.15.161:0/1522377324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 msgr2=0x7f83240cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 0x7f83240cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 -- 172.21.15.161:0/1522377324 >> v1:172.21.15.175:6789/0 conn(0x7f8324159fd0 legacy=0x7f832415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 -- 172.21.15.161:0/1522377324 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832415b170 con 0x7f83240b1740 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f8329425700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 0x7f83240cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.627+0000 7f832a427700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83240b1740 0x7f83240b1bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f831c00d150 tx=0x7f831c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d44cbfd8a480c3a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f8328c24700 1 -- 172.21.15.161:0/1522377324 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c010070 con 0x7f83240b1740 2023-08-10T10:29:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f8328c24700 1 -- 172.21.15.161:0/1522377324 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00ddc0 con 0x7f83240b1740 2023-08-10T10:29:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f8328c24700 1 -- 172.21.15.161:0/1522377324 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b310 con 0x7f83240b1740 2023-08-10T10:29:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 -- 172.21.15.161:0/1522377324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83240b1740 msgr2=0x7f83240b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83240b1740 0x7f83240b1bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f831c00d150 tx=0x7f831c00d460 comp rx=0 tx=0).stop 2023-08-10T10:29:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 -- 172.21.15.161:0/1522377324 shutdown_connections 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83240b1740 0x7f83240b1bd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 --2- 172.21.15.161:0/1522377324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f832415e4f0 0x7f83240cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 -- 172.21.15.161:0/1522377324 >> 172.21.15.161:0/1522377324 conn(0x7f83240cc740 msgr2=0x7f83240ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 -- 172.21.15.161:0/1522377324 shutdown_connections 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.628+0000 7f832be8a700 1 -- 172.21.15.161:0/1522377324 wait complete. 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.630+0000 7f832be8a700 1 Processor -- start 2023-08-10T10:29:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.630+0000 7f832be8a700 1 -- start start 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 0x7f83240b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 0x7f8324156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8324156870 con 0x7f832415e4f0 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83240c72d0 con 0x7f83240b1740 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832be8a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83240c7570 con 0x7f8324159fd0 2023-08-10T10:29:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59748/0 (socket says 172.21.15.161:59748) 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 -- 172.21.15.161:0/1305904467 learned_addr learned my addr 172.21.15.161:0/1305904467 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f8329425700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 0x7f8324156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f8329c26700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 0x7f83240b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 -- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 msgr2=0x7f8324156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 0x7f8324156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 -- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 msgr2=0x7f83240b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 0x7f83240b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 -- 172.21.15.161:0/1305904467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c00bd40 con 0x7f832415e4f0 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f8329c26700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 0x7f83240b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f8329425700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 0x7f8324156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f832a427700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8324070670 tx=0x7f831c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00bbc0 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00b4c0 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.631+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c004040 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.632+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83240c7850 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.632+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83240c7e10 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.632+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832404ecc0 con 0x7f832415e4f0 2023-08-10T10:29:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.633+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f831c0041a0 con 0x7f832415e4f0 2023-08-10T10:29:01.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.633+0000 7f831a7fc700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 0x7f830806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.633+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f831c08ce90 con 0x7f832415e4f0 2023-08-10T10:29:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.633+0000 7f8329c26700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 0x7f830806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.634+0000 7f8329c26700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 0x7f830806d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8314000f60 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.638+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f831c0581b0 con 0x7f832415e4f0 2023-08-10T10:29:01.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:01.823+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83240ccf20 con 0x7f832415e4f0 2023-08-10T10:29:02.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:02.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:02.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.491+0000 7f831a7fc700 1 -- 172.21.15.161:0/1305904467 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f831c0220d0 con 0x7f832415e4f0 2023-08-10T10:29:02.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 msgr2=0x7f830806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 0x7f830806d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8314000f60 tx=0x7f8314009040 comp rx=0 tx=0).stop 2023-08-10T10:29:02.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 msgr2=0x7f83240c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8324070670 tx=0x7f831c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 shutdown_connections 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f830806ace0 0x7f830806d1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f832415e4f0 0x7f83240c6d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83240b1740 0x7f83240b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 --2- 172.21.15.161:0/1305904467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8324159fd0 0x7f8324156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 >> 172.21.15.161:0/1305904467 conn(0x7f83240cc740 msgr2=0x7f832406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 shutdown_connections 2023-08-10T10:29:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.495+0000 7f832be8a700 1 -- 172.21.15.161:0/1305904467 wait complete. 2023-08-10T10:29:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-08-10T10:29:02.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:29:02.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.645+0000 7f0ac06d2700 1 Processor -- start 2023-08-10T10:29:02.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.645+0000 7f0ac06d2700 1 -- start start 2023-08-10T10:29:02.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0ac06d2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 0x7f0ab815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0ac06d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 0x7f0ab80cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0ac06d2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab815abb0 con 0x7f0ab80b1740 2023-08-10T10:29:02.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0ac06d2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab815ae90 con 0x7f0ab8159fd0 2023-08-10T10:29:02.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0ac06d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab815b170 con 0x7f0ab815a3b0 2023-08-10T10:29:02.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0abdc6d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 0x7f0ab80cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0abe46e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 0x7f0ab815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0abec6f700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0ab80b1740 0x7f0ab80cb1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:38552/0 (socket says 172.21.15.161:38552) 2023-08-10T10:29:02.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0abec6f700 1 -- 172.21.15.161:0/681734226 learned_addr learned my addr 172.21.15.161:0/681734226 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:02.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.646+0000 7f0abd46c700 1 -- 172.21.15.161:0/681734226 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55892929 0 0) 0x7f0ab815abb0 con 0x7f0ab80b1740 2023-08-10T10:29:02.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abd46c700 1 -- 172.21.15.161:0/681734226 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa40035b0 con 0x7f0ab80b1740 2023-08-10T10:29:02.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abdc6d700 1 -- 172.21.15.161:0/681734226 >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 msgr2=0x7f0ab815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:02.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abdc6d700 1 --2- 172.21.15.161:0/681734226 >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 0x7f0ab815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abdc6d700 1 -- 172.21.15.161:0/681734226 >> v1:172.21.15.175:6789/0 conn(0x7f0ab80b1740 legacy=0x7f0ab80cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abdc6d700 1 -- 172.21.15.161:0/681734226 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80cac90 con 0x7f0ab815a3b0 2023-08-10T10:29:02.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abe46e700 1 --2- 172.21.15.161:0/681734226 >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 0x7f0ab815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:02.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abdc6d700 1 --2- 172.21.15.161:0/681734226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 0x7f0ab80cdaa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009840 tx=0x7f0aa8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c431d07bb418cfef server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:02.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abd46c700 1 -- 172.21.15.161:0/681734226 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011830 con 0x7f0ab815a3b0 2023-08-10T10:29:02.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abd46c700 1 -- 172.21.15.161:0/681734226 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8011990 con 0x7f0ab815a3b0 2023-08-10T10:29:02.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0abd46c700 1 -- 172.21.15.161:0/681734226 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011d00 con 0x7f0ab815a3b0 2023-08-10T10:29:02.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0ac06d2700 1 -- 172.21.15.161:0/681734226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 msgr2=0x7f0ab80cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.647+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/681734226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 0x7f0ab80cdaa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009840 tx=0x7f0aa8009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:02.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 -- 172.21.15.161:0/681734226 shutdown_connections 2023-08-10T10:29:02.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/681734226 >> v2:172.21.15.175:3300/0 conn(0x7f0ab8159fd0 0x7f0ab815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/681734226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab815a3b0 0x7f0ab80cdaa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 -- 172.21.15.161:0/681734226 >> 172.21.15.161:0/681734226 conn(0x7f0ab80cc740 msgr2=0x7f0ab80ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:02.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 -- 172.21.15.161:0/681734226 shutdown_connections 2023-08-10T10:29:02.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.648+0000 7f0ac06d2700 1 -- 172.21.15.161:0/681734226 wait complete. 2023-08-10T10:29:02.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.649+0000 7f0ac06d2700 1 Processor -- start 2023-08-10T10:29:02.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.649+0000 7f0ac06d2700 1 -- start start 2023-08-10T10:29:02.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 0x7f0ab80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab815a3b0 0x7f0ab80b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c9e50 con 0x7f0ab8159fd0 2023-08-10T10:29:02.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c7470 con 0x7f0ab815a3b0 2023-08-10T10:29:02.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c7750 con 0x7f0ab80b1740 2023-08-10T10:29:02.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59758/0 (socket says 172.21.15.161:59758) 2023-08-10T10:29:02.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 -- 172.21.15.161:0/2512145596 learned_addr learned my addr 172.21.15.161:0/2512145596 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:02.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abec6f700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab815a3b0 0x7f0ab80b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abe46e700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 0x7f0ab80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 -- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 msgr2=0x7f0ab80c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 0x7f0ab80c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 -- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab815a3b0 msgr2=0x7f0ab80b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:02.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab815a3b0 0x7f0ab80b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:02.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 -- 172.21.15.161:0/2512145596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40094a0 con 0x7f0ab8159fd0 2023-08-10T10:29:02.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abe46e700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 0x7f0ab80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:02.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0abdc6d700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014040 tx=0x7f0aa8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:02.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80036a0 con 0x7f0ab8159fd0 2023-08-10T10:29:02.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa801f070 con 0x7f0ab8159fd0 2023-08-10T10:29:02.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa80094a0 con 0x7f0ab8159fd0 2023-08-10T10:29:02.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8003a00 con 0x7f0ab8159fd0 2023-08-10T10:29:02.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.650+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab80b3c80 con 0x7f0ab8159fd0 2023-08-10T10:29:02.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.651+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab804ecc0 con 0x7f0ab8159fd0 2023-08-10T10:29:02.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.652+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0aa8003b60 con 0x7f0ab8159fd0 2023-08-10T10:29:02.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.652+0000 7f0aaeffd700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:02.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.652+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0aa8021070 con 0x7f0ab8159fd0 2023-08-10T10:29:02.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.652+0000 7f0abe46e700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:02.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.653+0000 7f0abe46e700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009cf0 tx=0x7f0ab4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:02.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.657+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0aa8055df0 con 0x7f0ab8159fd0 2023-08-10T10:29:02.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:02.889+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ab80b5c40 con 0x7f0ab8159fd0 2023-08-10T10:29:03.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.490+0000 7f0aaeffd700 1 -- 172.21.15.161:0/2512145596 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0aa8059410 con 0x7f0ab8159fd0 2023-08-10T10:29:03.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 msgr2=0x7f0a9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009cf0 tx=0x7f0ab4008040 comp rx=0 tx=0).stop 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 msgr2=0x7f0ab8156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014040 tx=0x7f0aa8004750 comp rx=0 tx=0).stop 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 shutdown_connections 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab815a3b0 0x7f0ab80b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b1740 0x7f0ab80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 --2- 172.21.15.161:0/2512145596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab8159fd0 0x7f0ab8156ff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 >> 172.21.15.161:0/2512145596 conn(0x7f0ab80cc740 msgr2=0x7f0ab815d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:03.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 shutdown_connections 2023-08-10T10:29:03.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.493+0000 7f0ac06d2700 1 -- 172.21.15.161:0/2512145596 wait complete. 2023-08-10T10:29:03.495 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 3 and data pool 4 2023-08-10T10:29:03.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.631+0000 7f402afe3700 1 Processor -- start 2023-08-10T10:29:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.631+0000 7f402afe3700 1 -- start start 2023-08-10T10:29:03.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.632+0000 7f402afe3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415ded0 0x7f402415d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.632+0000 7f402afe3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f402415d870 0x7f40240cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.632+0000 7f402afe3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240ca630 con 0x7f40241597b0 2023-08-10T10:29:03.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.632+0000 7f402afe3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240cabf0 con 0x7f402415d870 2023-08-10T10:29:03.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.632+0000 7f402afe3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402415dd20 con 0x7f402415ded0 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f402415d870 0x7f40240cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4028d7f700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f40241597b0 0x7f40240c9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:38562/0 (socket says 172.21.15.161:38562) 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4028d7f700 1 -- 172.21.15.161:0/3207966268 learned_addr learned my addr 172.21.15.161:0/3207966268 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4023fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415ded0 0x7f402415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 -- 172.21.15.161:0/3207966268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415ded0 msgr2=0x7f402415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 --2- 172.21.15.161:0/3207966268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415ded0 0x7f402415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 -- 172.21.15.161:0/3207966268 >> v1:172.21.15.175:6789/0 conn(0x7f40241597b0 legacy=0x7f40240c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f40237fe700 1 -- 172.21.15.161:0/3207966268 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743513882 0 0) 0x7f40240ca630 con 0x7f40241597b0 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 -- 172.21.15.161:0/3207966268 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240ca910 con 0x7f402415d870 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f4029580700 1 --2- 172.21.15.161:0/3207966268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415d870 0x7f40240cdf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f401c009d90 tx=0x7f401c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faeaea30bdc87ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f40237fe700 1 -- 172.21.15.161:0/3207966268 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00e070 con 0x7f402415d870 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f40237fe700 1 -- 172.21.15.161:0/3207966268 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00bb20 con 0x7f402415d870 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.633+0000 7f40237fe700 1 -- 172.21.15.161:0/3207966268 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c012430 con 0x7f402415d870 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 -- 172.21.15.161:0/3207966268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415d870 msgr2=0x7f40240cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 --2- 172.21.15.161:0/3207966268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415d870 0x7f40240cdf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f401c009d90 tx=0x7f401c00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 -- 172.21.15.161:0/3207966268 shutdown_connections 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 --2- 172.21.15.161:0/3207966268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415d870 0x7f40240cdf00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 --2- 172.21.15.161:0/3207966268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415ded0 0x7f402415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 -- 172.21.15.161:0/3207966268 >> 172.21.15.161:0/3207966268 conn(0x7f40240cf450 msgr2=0x7f40240cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 -- 172.21.15.161:0/3207966268 shutdown_connections 2023-08-10T10:29:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.634+0000 7f402afe3700 1 -- 172.21.15.161:0/3207966268 wait complete. 2023-08-10T10:29:03.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.635+0000 7f402afe3700 1 Processor -- start 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.635+0000 7f402afe3700 1 -- start start 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 0x7f402414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415d870 0x7f402415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241f3a00 con 0x7f402415ded0 2023-08-10T10:29:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241f3e90 con 0x7f40241597b0 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f402afe3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40241f2df0 con 0x7f402415d870 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59774/0 (socket says 172.21.15.161:59774) 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 -- 172.21.15.161:0/405570493 learned_addr learned my addr 172.21.15.161:0/405570493 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4028d7f700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 0x7f402414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4023fff700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415d870 0x7f402415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 -- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415d870 msgr2=0x7f402415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415d870 0x7f402415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 -- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 msgr2=0x7f402414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 0x7f402414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 -- 172.21.15.161:0/405570493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009a70 con 0x7f402415ded0 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4028d7f700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 0x7f402414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.636+0000 7f4029580700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4024068430 tx=0x7f401c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.637+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c012430 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.637+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c020070 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.637+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40241f30d0 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.637+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c004280 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.637+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40241f3690 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.638+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40241f3bb0 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.638+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f401c0043e0 con 0x7f402415ded0 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.638+0000 7f40217fa700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 0x7f400806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.638+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f401c022070 con 0x7f402415ded0 2023-08-10T10:29:03.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.638+0000 7f4028d7f700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 0x7f400806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.639+0000 7f4028d7f700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 0x7f400806d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.643+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40241f3bb0 con 0x7f402415ded0 2023-08-10T10:29:03.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.832+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40240744e0 con 0x7f402415ded0 2023-08-10T10:29:03.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.833+0000 7f40217fa700 1 -- 172.21.15.161:0/405570493 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f401c0566f0 con 0x7f402415ded0 2023-08-10T10:29:03.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:03.834 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":23,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:02.889681+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:03.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 msgr2=0x7f400806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 0x7f400806d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007ca0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 msgr2=0x7f402415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4024068430 tx=0x7f401c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 shutdown_connections 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f400806ace0 0x7f400806d1a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f402415ded0 0x7f402415b110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40241597b0 0x7f402414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 --2- 172.21.15.161:0/405570493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f402415d870 0x7f402415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 >> 172.21.15.161:0/405570493 conn(0x7f40240cf450 msgr2=0x7f4024071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:03.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 shutdown_connections 2023-08-10T10:29:03.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.835+0000 7f402afe3700 1 -- 172.21.15.161:0/405570493 wait complete. 2023-08-10T10:29:03.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:03.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.967+0000 7f56eac32700 1 Processor -- start 2023-08-10T10:29:03.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.967+0000 7f56eac32700 1 -- start start 2023-08-10T10:29:03.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56eac32700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f56e406a190 0x7f56e40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56eac32700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e4071940 0x7f56e406a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56eac32700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40cf6a0 con 0x7f56e40aea70 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56eac32700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e406eb80 con 0x7f56e406a190 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56eac32700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40af510 con 0x7f56e4071940 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e3fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f56e40aea70 0x7f56e406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36786/0 (socket says 172.21.15.161:36786) 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e3fff700 1 -- 172.21.15.161:0/3790021116 learned_addr learned my addr 172.21.15.161:0/3790021116 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 --2- 172.21.15.161:0/3790021116 >> v2:172.21.15.175:3300/0 conn(0x7f56e406a190 0x7f56e40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e91cf700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e4071940 0x7f56e406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e37fe700 1 -- 172.21.15.161:0/3790021116 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159690258 0 0) 0x7f56e40cf6a0 con 0x7f56e40aea70 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e37fe700 1 -- 172.21.15.161:0/3790021116 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d40035b0 con 0x7f56e40aea70 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 -- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e4071940 msgr2=0x7f56e406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e4071940 0x7f56e406a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 -- 172.21.15.161:0/3790021116 >> v1:172.21.15.161:6789/0 conn(0x7f56e40aea70 legacy=0x7f56e406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 -- 172.21.15.161:0/3790021116 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e406ae60 con 0x7f56e406a190 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.968+0000 7f56e89ce700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e406a190 0x7f56e40c6810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009840 tx=0x7f56d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6f5f616a01299d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56e37fe700 1 -- 172.21.15.161:0/3790021116 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011830 con 0x7f56e406a190 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56e37fe700 1 -- 172.21.15.161:0/3790021116 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8011990 con 0x7f56e406a190 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56e37fe700 1 -- 172.21.15.161:0/3790021116 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011d00 con 0x7f56e406a190 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 -- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e406a190 msgr2=0x7f56e40c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e406a190 0x7f56e40c6810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009840 tx=0x7f56d8009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 -- 172.21.15.161:0/3790021116 shutdown_connections 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e4071940 0x7f56e406a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 --2- 172.21.15.161:0/3790021116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e406a190 0x7f56e40c6810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 -- 172.21.15.161:0/3790021116 >> 172.21.15.161:0/3790021116 conn(0x7f56e40cfd70 msgr2=0x7f56e40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 -- 172.21.15.161:0/3790021116 shutdown_connections 2023-08-10T10:29:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.969+0000 7f56eac32700 1 -- 172.21.15.161:0/3790021116 wait complete. 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.971+0000 7f56eac32700 1 Processor -- start 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.971+0000 7f56eac32700 1 -- start start 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e406a190 0x7f56e4146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e4071940 0x7f56e415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40ae890 con 0x7f56e40aea70 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415e270 con 0x7f56e4071940 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56eac32700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415e550 con 0x7f56e406a190 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59786/0 (socket says 172.21.15.161:59786) 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 -- 172.21.15.161:0/2607782671 learned_addr learned my addr 172.21.15.161:0/2607782671 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e3fff700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e4071940 0x7f56e415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e89ce700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e406a190 0x7f56e4146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 -- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e406a190 msgr2=0x7f56e4146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e406a190 0x7f56e4146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 -- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e4071940 msgr2=0x7f56e415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e4071940 0x7f56e415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 -- 172.21.15.161:0/2607782671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80094a0 con 0x7f56e40aea70 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.972+0000 7f56e91cf700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00efc0 tx=0x7f56dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc009ea0 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc00f040 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e415e830 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc00ced0 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e41531e0 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.973+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e4153400 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.974+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56dc014480 con 0x7f56e40aea70 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.974+0000 7f56e17fa700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 0x7f56c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.974+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56dc089f70 con 0x7f56e40aea70 2023-08-10T10:29:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.974+0000 7f56e89ce700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 0x7f56c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.975+0000 7f56e89ce700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 0x7f56c806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:03.979+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f56dc0bc330 con 0x7f56e40aea70 2023-08-10T10:29:04.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.167+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e40744e0 con 0x7f56e40aea70 2023-08-10T10:29:04.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.168+0000 7f56e17fa700 1 -- 172.21.15.161:0/2607782671 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f56dc058ab0 con 0x7f56e40aea70 2023-08-10T10:29:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:04.169 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":23,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:02.889681+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:04.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 msgr2=0x7f56c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 0x7f56c806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d801c040 comp rx=0 tx=0).stop 2023-08-10T10:29:04.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 msgr2=0x7f56e40ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00efc0 tx=0x7f56dc00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 shutdown_connections 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f56c806ace0 0x7f56c806d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e40aea70 0x7f56e40ae350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e406a190 0x7f56e4146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 --2- 172.21.15.161:0/2607782671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e4071940 0x7f56e415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 >> 172.21.15.161:0/2607782671 conn(0x7f56e40cfd70 msgr2=0x7f56e406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 shutdown_connections 2023-08-10T10:29:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.170+0000 7f56eac32700 1 -- 172.21.15.161:0/2607782671 wait complete. 2023-08-10T10:29:04.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:29:04.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.307+0000 7f6ecd0db700 1 Processor -- start 2023-08-10T10:29:04.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.307+0000 7f6ecd0db700 1 -- start start 2023-08-10T10:29:04.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.307+0000 7f6ecd0db700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 0x7f6ec80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ecd0db700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ec8160d20 0x7f6ec80cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ecd0db700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec806dc10 con 0x7f6ec80cf730 2023-08-10T10:29:04.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ecd0db700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec8071950 con 0x7f6ec8160d20 2023-08-10T10:29:04.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ecd0db700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80b2660 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ec8160d20 0x7f6ec80cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ec8160d20 0x7f6ec80cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59790/0 (socket says 172.21.15.161:59790) 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 -- 172.21.15.161:0/1231282855 learned_addr learned my addr 172.21.15.161:0/1231282855 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec6d9d700 1 --2- 172.21.15.161:0/1231282855 >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 0x7f6ec80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 -- 172.21.15.161:0/1231282855 >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 msgr2=0x7f6ec80b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 --2- 172.21.15.161:0/1231282855 >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 0x7f6ec80b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 -- 172.21.15.161:0/1231282855 >> v1:172.21.15.175:6789/0 conn(0x7f6ec80cf730 legacy=0x7f6ec806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 -- 172.21.15.161:0/1231282855 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec806dff0 con 0x7f6ec8160d20 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec6d9d700 1 --2- 172.21.15.161:0/1231282855 >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 0x7f6ec80b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec659c700 1 --2- 172.21.15.161:0/1231282855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec8160d20 0x7f6ec80cf1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b2820 tx=0x7f6ebc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2a0cf7dece18fc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec5d9b700 1 -- 172.21.15.161:0/1231282855 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00b870 con 0x7f6ec8160d20 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec5d9b700 1 -- 172.21.15.161:0/1231282855 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00b9d0 con 0x7f6ec8160d20 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.308+0000 7f6ec5d9b700 1 -- 172.21.15.161:0/1231282855 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00bd60 con 0x7f6ec8160d20 2023-08-10T10:29:04.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 -- 172.21.15.161:0/1231282855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec8160d20 msgr2=0x7f6ec80cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/1231282855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec8160d20 0x7f6ec80cf1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b2820 tx=0x7f6ebc009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 -- 172.21.15.161:0/1231282855 shutdown_connections 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/1231282855 >> v2:172.21.15.175:3300/0 conn(0x7f6ec80cb9f0 0x7f6ec80b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/1231282855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec8160d20 0x7f6ec80cf1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 -- 172.21.15.161:0/1231282855 >> 172.21.15.161:0/1231282855 conn(0x7f6ec80cc740 msgr2=0x7f6ec80ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 -- 172.21.15.161:0/1231282855 shutdown_connections 2023-08-10T10:29:04.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.309+0000 7f6ecd0db700 1 -- 172.21.15.161:0/1231282855 wait complete. 2023-08-10T10:29:04.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.310+0000 7f6ecd0db700 1 Processor -- start 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 -- start start 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec80cf730 0x7f6ec80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec8160d20 0x7f6ec80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec815ec60 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c5340 con 0x7f6ec8160d20 2023-08-10T10:29:04.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ecd0db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c4730 con 0x7f6ec80cf730 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ec6d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ec6d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59794/0 (socket says 172.21.15.161:59794) 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ec6d9d700 1 -- 172.21.15.161:0/3885747449 learned_addr learned my addr 172.21.15.161:0/3885747449 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ec759e700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec8160d20 0x7f6ec80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.311+0000 7f6ec659c700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec80cf730 0x7f6ec80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 -- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec80cf730 msgr2=0x7f6ec80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec80cf730 0x7f6ec80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 -- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec8160d20 msgr2=0x7f6ec80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec8160d20 0x7f6ec80b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 -- 172.21.15.161:0/3885747449 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc009550 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ec6d9d700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e810 tx=0x7f6eb800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800c020 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8004250 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80c4a10 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80036a0 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.312+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80c4fd0 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.313+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec80c6fd0 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.313+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6eb8003800 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.314+0000 7f6eaf7fe700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.314+0000 7f6ec659c700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.314+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6eb8088dc0 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.314+0000 7f6ec659c700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 0x7f6eb406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc000c00 tx=0x7f6ebc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:04.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.318+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6eb8053e70 con 0x7f6ec80cb9f0 2023-08-10T10:29:04.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:04.554+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6ec8160b10 con 0x7f6ec80cb9f0 2023-08-10T10:29:05.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.511+0000 7f6eaf7fe700 1 -- 172.21.15.161:0/3885747449 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ec8160b10 con 0x7f6ec80cb9f0 2023-08-10T10:29:05.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 msgr2=0x7f6eb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 0x7f6eb406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc000c00 tx=0x7f6ebc008030 comp rx=0 tx=0).stop 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 msgr2=0x7f6ec815e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e810 tx=0x7f6eb800eb20 comp rx=0 tx=0).stop 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 shutdown_connections 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec8160d20 0x7f6ec80b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec80cb9f0 0x7f6ec815e720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 --2- 172.21.15.161:0/3885747449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec80cf730 0x7f6ec80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 >> 172.21.15.161:0/3885747449 conn(0x7f6ec80cc740 msgr2=0x7f6ec815f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:05.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 shutdown_connections 2023-08-10T10:29:05.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.514+0000 7f6ecd0db700 1 -- 172.21.15.161:0/3885747449 wait complete. 2023-08-10T10:29:05.529 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:29:05.529 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:29:05.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.658+0000 7fbdcc5d4700 1 Processor -- start 2023-08-10T10:29:05.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.658+0000 7fbdcc5d4700 1 -- start start 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcc5d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdc415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcc5d4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbdc415a3b0 0x7fbdc40cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcc5d4700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc415abb0 con 0x7fbdc40b1740 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcc5d4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc415ae90 con 0x7fbdc415a3b0 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcc5d4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc415b170 con 0x7fbdc4159fd0 2023-08-10T10:29:05.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcab71700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbdc40b1740 0x7fbdc40cb1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36812/0 (socket says 172.21.15.161:36812) 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdcab71700 1 -- 172.21.15.161:0/109931058 learned_addr learned my addr 172.21.15.161:0/109931058 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/109931058 >> v2:172.21.15.175:3300/0 conn(0x7fbdc415a3b0 0x7fbdc40cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdca370700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdc415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.659+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80159201 0 0) 0x7fbdc415abb0 con 0x7fbdc40b1740 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb00035b0 con 0x7fbdc40b1740 2023-08-10T10:29:05.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4213832360 0 0) 0x7fbdb00035b0 con 0x7fbdc40b1740 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 msgr2=0x7fbdc415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdc415e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 >> v2:172.21.15.175:3300/0 conn(0x7fbdc415a3b0 msgr2=0x7fbdc40cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 --2- 172.21.15.161:0/109931058 >> v2:172.21.15.175:3300/0 conn(0x7fbdc415a3b0 0x7fbdc40cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40cac90 con 0x7fbdc40b1740 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fbdbc0019f0 con 0x7fbdc40b1740 2023-08-10T10:29:05.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 >> v1:172.21.15.161:6789/0 conn(0x7fbdc40b1740 legacy=0x7fbdc40cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdb0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdb0003f80 0x7fbdb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdb0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc415ae90 con 0x7fbdb0004d90 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc415b170 con 0x7fbdb0003f80 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb000ba10 con 0x7fbdc4159fd0 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/109931058 >> v2:172.21.15.175:3300/0 conn(0x7fbdc415a3b0 0x7fbdc40cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:05.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdb0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdca370700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdb0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdb0003f80 0x7fbdb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 -- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 msgr2=0x7fbdb0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc4159fd0 0x7fbdb0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 -- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdb0003f80 msgr2=0x7fbdb0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdb0003f80 0x7fbdb0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 -- 172.21.15.161:0/109931058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb00035b0 con 0x7fbdb0004d90 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdcab71700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdb0005210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00a860 tx=0x7fbdb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfcfeb10d79a44e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc012600 con 0x7fbdb0004d90 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc012760 con 0x7fbdb0004d90 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.660+0000 7fbdc936e700 1 -- 172.21.15.161:0/109931058 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc012b10 con 0x7fbdb0004d90 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/109931058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 msgr2=0x7fbdb0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/109931058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdb0005210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00a860 tx=0x7fbdb0005880 comp rx=0 tx=0).stop 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcab71700 1 -- 172.21.15.161:0/109931058 reap_dead start 2023-08-10T10:29:05.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/109931058 shutdown_connections 2023-08-10T10:29:05.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/109931058 >> 172.21.15.161:0/109931058 conn(0x7fbdc40cc740 msgr2=0x7fbdc40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:05.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/109931058 shutdown_connections 2023-08-10T10:29:05.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.661+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/109931058 wait complete. 2023-08-10T10:29:05.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.663+0000 7fbdcc5d4700 1 Processor -- start 2023-08-10T10:29:05.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.663+0000 7fbdcc5d4700 1 -- start start 2023-08-10T10:29:05.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc40b28e0 0x7fbdc40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc40c7c50 0x7fbdc41534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40c9d40 con 0x7fbdb0004d90 2023-08-10T10:29:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc414dc90 con 0x7fbdc40b28e0 2023-08-10T10:29:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40c94a0 con 0x7fbdc40c7c50 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59814/0 (socket says 172.21.15.161:59814) 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 -- 172.21.15.161:0/3033579978 learned_addr learned my addr 172.21.15.161:0/3033579978 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 -- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc40c7c50 msgr2=0x7fbdc41534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc40c7c50 0x7fbdc41534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc40b28e0 0x7fbdc40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 -- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc40b28e0 msgr2=0x7fbdc40c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc40b28e0 0x7fbdc40c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 -- 172.21.15.161:0/3033579978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40c9780 con 0x7fbdb0004d90 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdca370700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4011a20 tx=0x7fbdb4011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400f940 con 0x7fbdb0004d90 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb400faa0 con 0x7fbdb0004d90 2023-08-10T10:29:05.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400fe50 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc40c9a60 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.664+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc4153c00 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.665+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc4153e80 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.666+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdb4014440 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.666+0000 7fbdbaffd700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 0x7fbda806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.666+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbdb4089b70 con 0x7fbdb0004d90 2023-08-10T10:29:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.666+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 0x7fbda806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.667+0000 7fbdc9b6f700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 0x7fbda806d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406e090 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.670+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbdb4058820 con 0x7fbdb0004d90 2023-08-10T10:29:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:05.901+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbdc414dfc0 con 0x7fbdb0004d90 2023-08-10T10:29:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.515+0000 7fbdbaffd700 1 -- 172.21.15.161:0/3033579978 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbdb40220c0 con 0x7fbdb0004d90 2023-08-10T10:29:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 msgr2=0x7fbda806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 0x7fbda806d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406e090 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 msgr2=0x7fbdc40c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4011a20 tx=0x7fbdb4011de0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 shutdown_connections 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbda806ace0 0x7fbda806d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc40c7c50 0x7fbdc41534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdb0004d90 0x7fbdc40c6180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 --2- 172.21.15.161:0/3033579978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc40b28e0 0x7fbdc40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 >> 172.21.15.161:0/3033579978 conn(0x7fbdc40cc740 msgr2=0x7fbdc406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 shutdown_connections 2023-08-10T10:29:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.518+0000 7fbdcc5d4700 1 -- 172.21.15.161:0/3033579978 wait complete. 2023-08-10T10:29:06.532 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:29:06.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:06.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.657+0000 7f3ad7045700 1 Processor -- start 2023-08-10T10:29:06.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.657+0000 7f3ad7045700 1 -- start start 2023-08-10T10:29:06.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad7045700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ad00aea70 0x7f3ad00c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad7045700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad00cf6a0 con 0x7f3ad0071940 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad7045700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad006ae60 con 0x7f3ad006a190 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad7045700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad006eb80 con 0x7f3ad00aea70 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad55e2700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3ad0071940 0x7f3ad006a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36832/0 (socket says 172.21.15.161:36832) 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3ad55e2700 1 -- 172.21.15.161:0/3086991834 learned_addr learned my addr 172.21.15.161:0/3086991834 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477555247 0 0) 0x7f3ad00cf6a0 con 0x7f3ad0071940 2023-08-10T10:29:06.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac00035b0 con 0x7f3ad0071940 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.658+0000 7f3acffff700 1 --2- 172.21.15.161:0/3086991834 >> v2:172.21.15.175:3300/0 conn(0x7f3ad00aea70 0x7f3ad00c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719157728 0 0) 0x7f3ac00035b0 con 0x7f3ad0071940 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 >> v2:172.21.15.175:3300/0 conn(0x7f3ad00aea70 msgr2=0x7f3ad00c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 --2- 172.21.15.161:0/3086991834 >> v2:172.21.15.175:3300/0 conn(0x7f3ad00aea70 0x7f3ad00c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 >> v1:172.21.15.175:6789/0 conn(0x7f3ad006a190 legacy=0x7f3ad006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad006e7a0 con 0x7f3ad0071940 2023-08-10T10:29:06.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f3ac80019f0 con 0x7f3ad0071940 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 >> v1:172.21.15.161:6789/0 conn(0x7f3ad0071940 legacy=0x7f3ad006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0003a00 0x7f3ac0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac0004850 0x7f3ac0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 0x7f3ac000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad006eb80 con 0x7f3ac0005210 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac000c0b0 con 0x7f3ac0004850 2023-08-10T10:29:06.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac000c270 con 0x7f3ac0003a00 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 0x7f3ac000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acffff700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac0004850 0x7f3ac0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad4de1700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0003a00 0x7f3ac0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 -- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0003a00 msgr2=0x7f3ac0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0003a00 0x7f3ac0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 -- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac0004850 msgr2=0x7f3ac0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac0004850 0x7f3ac0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 -- 172.21.15.161:0/3086991834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac00035b0 con 0x7f3ac0005210 2023-08-10T10:29:06.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 -- 172.21.15.161:0/3086991834 reap_dead start 2023-08-10T10:29:06.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 0x7f3ac000ba10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800a830 tx=0x7f3ac0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37bde99e4ba3de0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:06.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800a2f0 con 0x7f3ac0005210 2023-08-10T10:29:06.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8012600 con 0x7f3ac0005210 2023-08-10T10:29:06.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.659+0000 7f3acf7fe700 1 -- 172.21.15.161:0/3086991834 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80129b0 con 0x7f3ac0005210 2023-08-10T10:29:06.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 -- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 msgr2=0x7f3ac000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 0x7f3ac000ba10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800a830 tx=0x7f3ac0005880 comp rx=0 tx=0).stop 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 -- 172.21.15.161:0/3086991834 shutdown_connections 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 --2- 172.21.15.161:0/3086991834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac0005210 0x7f3ac000ba10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 -- 172.21.15.161:0/3086991834 >> 172.21.15.161:0/3086991834 conn(0x7f3ad00cfd70 msgr2=0x7f3ad00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 -- 172.21.15.161:0/3086991834 shutdown_connections 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.660+0000 7f3ad7045700 1 -- 172.21.15.161:0/3086991834 wait complete. 2023-08-10T10:29:06.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.661+0000 7f3ad7045700 1 Processor -- start 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.661+0000 7f3ad7045700 1 -- start start 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0005210 0x7f3ad015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad014f2c0 0x7f3ad015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad006ac80 con 0x7f3ad015de50 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0158d60 con 0x7f3ad014f2c0 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad7045700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad014ebd0 con 0x7f3ac0005210 2023-08-10T10:29:06.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59836/0 (socket says 172.21.15.161:59836) 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 -- 172.21.15.161:0/2262952282 learned_addr learned my addr 172.21.15.161:0/2262952282 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3acffff700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad014f2c0 0x7f3ad015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad4de1700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0005210 0x7f3ad015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 -- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0005210 msgr2=0x7f3ad015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0005210 0x7f3ad015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 -- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad014f2c0 msgr2=0x7f3ad015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad014f2c0 0x7f3ad015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.662+0000 7f3ad55e2700 1 -- 172.21.15.161:0/2262952282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00b5370 con 0x7f3ad015de50 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3ad55e2700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0071630 tx=0x7f3ac8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80017b0 con 0x7f3ad015de50 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8001930 con 0x7f3ad015de50 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad00b5650 con 0x7f3ad015de50 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac801e670 con 0x7f3ad015de50 2023-08-10T10:29:06.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.663+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad0158fb0 con 0x7f3ad015de50 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.664+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad00744e0 con 0x7f3ad015de50 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.664+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ac801e7d0 con 0x7f3ad015de50 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.664+0000 7f3acd7fa700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 0x7f3ab406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.665+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ac808b530 con 0x7f3ad015de50 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.665+0000 7f3ad4de1700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 0x7f3ab406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:06.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.665+0000 7f3ad4de1700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 0x7f3ab406d1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4007fd0 tx=0x7f3ac4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:06.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.669+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3ac8056670 con 0x7f3ad015de50 2023-08-10T10:29:06.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.897+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ad006a8f0 con 0x7f3ad015de50 2023-08-10T10:29:06.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.897+0000 7f3acd7fa700 1 -- 172.21.15.161:0/2262952282 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f3ac8059c90 con 0x7f3ad015de50 2023-08-10T10:29:06.898 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:06.898 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 msgr2=0x7f3ab406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 0x7f3ab406d1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4007fd0 tx=0x7f3ac4009040 comp rx=0 tx=0).stop 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 msgr2=0x7f3ad01594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0071630 tx=0x7f3ac8001d80 comp rx=0 tx=0).stop 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 shutdown_connections 2023-08-10T10:29:06.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3ab406ad10 0x7f3ab406d1d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad015de50 0x7f3ad01594d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ac0005210 0x7f3ad015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 --2- 172.21.15.161:0/2262952282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad014f2c0 0x7f3ad015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.899+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 >> 172.21.15.161:0/2262952282 conn(0x7f3ad00cfd70 msgr2=0x7f3ad00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.900+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 shutdown_connections 2023-08-10T10:29:06.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:06.900+0000 7f3ad7045700 1 -- 172.21.15.161:0/2262952282 wait complete. 2023-08-10T10:29:06.902 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:06.912 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:07.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.032+0000 7f10ff51a700 1 Processor -- start 2023-08-10T10:29:07.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.032+0000 7f10ff51a700 1 -- start start 2023-08-10T10:29:07.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 0x7f10f80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10f80aea70 0x7f10f806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 0x7f10f806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f806eb80 con 0x7f10f80aea70 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80af510 con 0x7f10f806a190 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ff51a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f806b140 con 0x7f10f8071940 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10f80aea70 0x7f10f806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10f80aea70 0x7f10f806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59842/0 (socket says 172.21.15.161:59842) 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 -- 172.21.15.161:0/2628438290 learned_addr learned my addr 172.21.15.161:0/2628438290 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fdab7700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 0x7f10f806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fd2b6700 1 --2- 172.21.15.161:0/2628438290 >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 0x7f10f80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 -- 172.21.15.161:0/2628438290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 msgr2=0x7f10f806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 0x7f10f806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 -- 172.21.15.161:0/2628438290 >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 msgr2=0x7f10f80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 --2- 172.21.15.161:0/2628438290 >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 0x7f10f80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 -- 172.21.15.161:0/2628438290 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80cf6a0 con 0x7f10f80aea70 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fd2b6700 1 --2- 172.21.15.161:0/2628438290 >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 0x7f10f80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:07.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fdab7700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 0x7f10f806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10fcab5700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f80aea70 0x7f10f806cd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10f806cc40 tx=0x7f10f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da54f5689628227 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ebfff700 1 -- 172.21.15.161:0/2628438290 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400b870 con 0x7f10f80aea70 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ebfff700 1 -- 172.21.15.161:0/2628438290 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400b9d0 con 0x7f10f80aea70 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.033+0000 7f10ebfff700 1 -- 172.21.15.161:0/2628438290 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400bd60 con 0x7f10f80aea70 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 -- 172.21.15.161:0/2628438290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f80aea70 msgr2=0x7f10f806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f80aea70 0x7f10f806cd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10f806cc40 tx=0x7f10f4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 -- 172.21.15.161:0/2628438290 shutdown_connections 2023-08-10T10:29:07.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f8071940 0x7f10f806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 --2- 172.21.15.161:0/2628438290 >> v2:172.21.15.175:3300/0 conn(0x7f10f806a190 0x7f10f80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 --2- 172.21.15.161:0/2628438290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f80aea70 0x7f10f806cd20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 -- 172.21.15.161:0/2628438290 >> 172.21.15.161:0/2628438290 conn(0x7f10f80cfd70 msgr2=0x7f10f80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 -- 172.21.15.161:0/2628438290 shutdown_connections 2023-08-10T10:29:07.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.034+0000 7f10ff51a700 1 -- 172.21.15.161:0/2628438290 wait complete. 2023-08-10T10:29:07.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.035+0000 7f10ff51a700 1 Processor -- start 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.035+0000 7f10ff51a700 1 -- start start 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f806a190 0x7f10f8159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f80aea70 0x7f10f815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80b4990 con 0x7f10f8071940 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80b33b0 con 0x7f10f80aea70 2023-08-10T10:29:07.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10ff51a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80b3690 con 0x7f10f806a190 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59850/0 (socket says 172.21.15.161:59850) 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 -- 172.21.15.161:0/3069095502 learned_addr learned my addr 172.21.15.161:0/3069095502 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fd2b6700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f806a190 0x7f10f8159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fdab7700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f80aea70 0x7f10f815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 -- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f806a190 msgr2=0x7f10f8159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f806a190 0x7f10f8159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 -- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f80aea70 msgr2=0x7f10f815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f80aea70 0x7f10f815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.036+0000 7f10fcab5700 1 -- 172.21.15.161:0/3069095502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009550 con 0x7f10f8071940 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10fcab5700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10f4000c00 tx=0x7f10f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4004510 con 0x7f10f8071940 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f40036a0 con 0x7f10f8071940 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f80b3970 con 0x7f10f8071940 2023-08-10T10:29:07.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4003a30 con 0x7f10f8071940 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.037+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f80b3f30 con 0x7f10f8071940 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.038+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f80744e0 con 0x7f10f8071940 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.038+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10f4003b90 con 0x7f10f8071940 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.039+0000 7f10e9ffb700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.039+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10f408aad0 con 0x7f10f8071940 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.039+0000 7f10fd2b6700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.039+0000 7f10fd2b6700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 0x7f10dc06d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cc660 tx=0x7f10ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.043+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10f4055c90 con 0x7f10f8071940 2023-08-10T10:29:07.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.233+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10f80b0e80 con 0x7f10f8071940 2023-08-10T10:29:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.234+0000 7f10e9ffb700 1 -- 172.21.15.161:0/3069095502 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f10f4029090 con 0x7f10f8071940 2023-08-10T10:29:07.234 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:07.234 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 msgr2=0x7f10dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 0x7f10dc06d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cc660 tx=0x7f10ec008040 comp rx=0 tx=0).stop 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 msgr2=0x7f10f80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10f4000c00 tx=0x7f10f4004750 comp rx=0 tx=0).stop 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 shutdown_connections 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f80aea70 0x7f10f815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f806a190 0x7f10f8159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 --2- 172.21.15.161:0/3069095502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f8071940 0x7f10f80b4450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 >> 172.21.15.161:0/3069095502 conn(0x7f10f80cfd70 msgr2=0x7f10f8070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 shutdown_connections 2023-08-10T10:29:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.236+0000 7f10ff51a700 1 -- 172.21.15.161:0/3069095502 wait complete. 2023-08-10T10:29:07.249 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:29:07.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:07.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.369+0000 7f943b043700 1 Processor -- start 2023-08-10T10:29:07.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.369+0000 7f943b043700 1 -- start start 2023-08-10T10:29:07.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f943b043700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f943406df40 0x7f943406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f943b043700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f943415a5c0 0x7f943415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f943b043700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9434071ee0 con 0x7f9434154620 2023-08-10T10:29:07.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f943b043700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340c5890 con 0x7f943415a5c0 2023-08-10T10:29:07.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f943b043700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943406e910 con 0x7f943406df40 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f943415a5c0 0x7f943415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f943415a5c0 0x7f943415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59860/0 (socket says 172.21.15.161:59860) 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 -- 172.21.15.161:0/3058299038 learned_addr learned my addr 172.21.15.161:0/3058299038 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f9438ddf700 1 --1- 172.21.15.161:0/3058299038 >> v1:172.21.15.161:6789/0 conn(0x7f9434154620 0x7f94340717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36862/0 (socket says 172.21.15.161:36862) 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f9433fff700 1 --2- 172.21.15.161:0/3058299038 >> v2:172.21.15.175:3300/0 conn(0x7f943406df40 0x7f943406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 -- 172.21.15.161:0/3058299038 >> v2:172.21.15.175:3300/0 conn(0x7f943406df40 msgr2=0x7f943406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 --2- 172.21.15.161:0/3058299038 >> v2:172.21.15.175:3300/0 conn(0x7f943406df40 0x7f943406e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 -- 172.21.15.161:0/3058299038 >> v1:172.21.15.161:6789/0 conn(0x7f9434154620 legacy=0x7f94340717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94337fe700 1 -- 172.21.15.161:0/3058299038 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226790346 0 0) 0x7f9434071ee0 con 0x7f9434154620 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.370+0000 7f94395e0700 1 -- 172.21.15.161:0/3058299038 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943415b290 con 0x7f943415a5c0 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f94395e0700 1 --2- 172.21.15.161:0/3058299038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943415a5c0 0x7f943415a9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94340cc790 tx=0x7f942c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd8bd53f58a1b17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f94337fe700 1 -- 172.21.15.161:0/3058299038 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00e070 con 0x7f943415a5c0 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f94337fe700 1 -- 172.21.15.161:0/3058299038 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00b920 con 0x7f943415a5c0 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f94337fe700 1 -- 172.21.15.161:0/3058299038 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00bcd0 con 0x7f943415a5c0 2023-08-10T10:29:07.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 -- 172.21.15.161:0/3058299038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943415a5c0 msgr2=0x7f943415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 --2- 172.21.15.161:0/3058299038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943415a5c0 0x7f943415a9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94340cc790 tx=0x7f942c00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 -- 172.21.15.161:0/3058299038 shutdown_connections 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 --2- 172.21.15.161:0/3058299038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943415a5c0 0x7f943415a9f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 --2- 172.21.15.161:0/3058299038 >> v2:172.21.15.175:3300/0 conn(0x7f943406df40 0x7f943406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 -- 172.21.15.161:0/3058299038 >> 172.21.15.161:0/3058299038 conn(0x7f94340cfd70 msgr2=0x7f94340d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 -- 172.21.15.161:0/3058299038 shutdown_connections 2023-08-10T10:29:07.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.371+0000 7f943b043700 1 -- 172.21.15.161:0/3058299038 wait complete. 2023-08-10T10:29:07.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.372+0000 7f943b043700 1 Processor -- start 2023-08-10T10:29:07.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 -- start start 2023-08-10T10:29:07.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 0x7f94341ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943415a5c0 0x7f94340c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c7a20 con 0x7f943406df40 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c7710 con 0x7f9434154620 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f943b043700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340b47b0 con 0x7f943415a5c0 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f9438ddf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f9438ddf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59862/0 (socket says 172.21.15.161:59862) 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.373+0000 7f9438ddf700 1 -- 172.21.15.161:0/281919383 learned_addr learned my addr 172.21.15.161:0/281919383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9433fff700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 0x7f94341ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 -- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943415a5c0 msgr2=0x7f94340c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943415a5c0 0x7f94340c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 -- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 msgr2=0x7f94341ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 0x7f94341ee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 -- 172.21.15.161:0/281919383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f943406df40 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9433fff700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 0x7f94341ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f9438ddf700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94280011e0 tx=0x7f942800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428004c80 con 0x7f943406df40 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428004e00 con 0x7f943406df40 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94340b4a30 con 0x7f943406df40 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428007310 con 0x7f943406df40 2023-08-10T10:29:07.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.374+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94340b4ff0 con 0x7f943406df40 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.375+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9428007470 con 0x7f943406df40 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.375+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94340c7b60 con 0x7f943406df40 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.376+0000 7f94317fa700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 0x7f941806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.376+0000 7f9433fff700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 0x7f941806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.376+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9428089220 con 0x7f943406df40 2023-08-10T10:29:07.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.376+0000 7f9433fff700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 0x7f941806d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94341f2df0 tx=0x7f9420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.380+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9428054360 con 0x7f943406df40 2023-08-10T10:29:07.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.564+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9434070cf0 con 0x7f941806ace0 2023-08-10T10:29:07.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.572+0000 7f94317fa700 1 -- 172.21.15.161:0/281919383 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273039 (secure 0 0 0) 0x7f9420009610 con 0x7f941806ace0 2023-08-10T10:29:07.576 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:07.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 msgr2=0x7f941806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 0x7f941806d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94341f2df0 tx=0x7f9420008040 comp rx=0 tx=0).stop 2023-08-10T10:29:07.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 msgr2=0x7f94340b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94280011e0 tx=0x7f942800cae0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 shutdown_connections 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f941806ace0 0x7f941806d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943415a5c0 0x7f94340c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f943406df40 0x7f94340b4270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 --2- 172.21.15.161:0/281919383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9434154620 0x7f94341ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 >> 172.21.15.161:0/281919383 conn(0x7f94340cfd70 msgr2=0x7f94340d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 shutdown_connections 2023-08-10T10:29:07.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.575+0000 7f943b043700 1 -- 172.21.15.161:0/281919383 wait complete. 2023-08-10T10:29:07.580 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:07.588 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-10T10:29:06.187318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":28,"acting":28,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218928,"kb_used_data":2748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755792,"statfs":{"total":773094113280,"available":772869931008,"internally_reserved":0,"allocated":2813952,"data_stored":1719254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.705932"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-10T10:28:59.302542+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:28:59.302542+0000","last_peered":"2023-08-10T10:28:59.302542+0000","last_clean":"2023-08-10T10:28:59.302542+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:28:59.302542+0000","last_undegraded":"2023-08-10T10:28:59.302542+0000","last_fullsized":"2023-08-10T10:28:59.302542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:17.452848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309083+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:28:58.309083+0000","last_peered":"2023-08-10T10:28:58.309083+0000","last_clean":"2023-08-10T10:28:58.309083+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:28:58.309083+0000","last_undegraded":"2023-08-10T10:28:58.309083+0000","last_fullsized":"2023-08-10T10:28:58.309083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:26:55.561650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309059+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:28:58.309059+0000","last_peered":"2023-08-10T10:28:58.309059+0000","last_clean":"2023-08-10T10:28:58.309059+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:28:58.309059+0000","last_undegraded":"2023-08-10T10:28:58.309059+0000","last_fullsized":"2023-08-10T10:28:58.309059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:58.183462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.299732+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:28:58.299732+0000","last_peered":"2023-08-10T10:28:58.299732+0000","last_clean":"2023-08-10T10:28:58.299732+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:28:58.299732+0000","last_undegraded":"2023-08-10T10:28:58.299732+0000","last_fullsized":"2023-08-10T10:28:58.299732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:08.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309295+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:28:58.309295+0000","last_peered":"2023-08-10T10:28:58.309295+0000","last_clean":"2023-08-10T10:28:58.309295+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:28:58.309295+0000","last_undegraded":"2023-08-10T10:28:58.309295+0000","last_fullsized":"2023-08-10T10:28:58.309295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:31:10.374174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309306+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:28:58.309306+0000","last_peered":"2023-08-10T10:28:58.309306+0000","last_clean":"2023-08-10T10:28:58.309306+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:28:58.309306+0000","last_undegraded":"2023-08-10T10:28:58.309306+0000","last_fullsized":"2023-08-10T10:28:58.309306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:08.899683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-10T10:28:59.302535+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:28:59.302535+0000","last_peered":"2023-08-10T10:28:59.302535+0000","last_clean":"2023-08-10T10:28:59.302535+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:28:59.302535+0000","last_undegraded":"2023-08-10T10:28:59.302535+0000","last_fullsized":"2023-08-10T10:28:59.302535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:40.378341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.306385+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:28:58.306385+0000","last_peered":"2023-08-10T10:28:58.306385+0000","last_clean":"2023-08-10T10:28:58.306385+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:28:58.306385+0000","last_undegraded":"2023-08-10T10:28:58.306385+0000","last_fullsized":"2023-08-10T10:28:58.306385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:11.132103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":652319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:07.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:07.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.748+0000 7f54ac8b3700 1 Processor -- start 2023-08-10T10:29:07.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.748+0000 7f54ac8b3700 1 -- start start 2023-08-10T10:29:07.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54ac8b3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f54a80717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54ac8b3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54a806e650 0x7f54a815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54ac8b3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a815b290 con 0x7f54a8071d10 2023-08-10T10:29:07.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54ac8b3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80c5890 con 0x7f54a806e650 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54ac8b3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815b570 con 0x7f54a8154620 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54a5d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f54a8071d10 0x7f54a806df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36876/0 (socket says 172.21.15.161:36876) 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.749+0000 7f54a5d9b700 1 -- 172.21.15.161:0/2598770696 learned_addr learned my addr 172.21.15.161:0/2598770696 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531476460 0 0) 0x7f54a815b290 con 0x7f54a8071d10 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/2598770696 >> v2:172.21.15.175:3300/0 conn(0x7f54a806e650 0x7f54a815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a659c700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f54a80717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54900057c0 con 0x7f54a8071d10 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1084741909 0 0) 0x7f54900057c0 con 0x7f54a8071d10 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 msgr2=0x7f54a80717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f54a80717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 >> v2:172.21.15.175:3300/0 conn(0x7f54a806e650 msgr2=0x7f54a815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 --2- 172.21.15.161:0/2598770696 >> v2:172.21.15.175:3300/0 conn(0x7f54a806e650 0x7f54a815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8070cf0 con 0x7f54a8071d10 2023-08-10T10:29:07.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f5498001670 con 0x7f54a8071d10 2023-08-10T10:29:07.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 >> v1:172.21.15.161:6789/0 conn(0x7f54a8071d10 legacy=0x7f54a806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490005c10 0x7f5490006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f5490006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5490006fa0 0x7f5490007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c5890 con 0x7f5490006fa0 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815b570 con 0x7f5490005c10 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549000dc20 con 0x7f54a8154620 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5490006fa0 0x7f5490007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a659c700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490005c10 0x7f5490006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a5d9b700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f5490006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 -- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 msgr2=0x7f5490006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a8154620 0x7f5490006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 -- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490005c10 msgr2=0x7f5490006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490005c10 0x7f5490006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a6d9d700 1 -- 172.21.15.161:0/2598770696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900057c0 con 0x7f5490006fa0 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.750+0000 7f54a659c700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490005c10 0x7f5490006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5490006fa0 0x7f5490007420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009fc0 tx=0x7f5490007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95baf861f55adc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000ec30 con 0x7f5490006fa0 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000f040 con 0x7f5490006fa0 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54a559a700 1 -- 172.21.15.161:0/2598770696 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0014480 con 0x7f5490006fa0 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 -- 172.21.15.161:0/2598770696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5490006fa0 msgr2=0x7f5490007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/2598770696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5490006fa0 0x7f5490007420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009fc0 tx=0x7f5490007a90 comp rx=0 tx=0).stop 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54a6d9d700 1 -- 172.21.15.161:0/2598770696 reap_dead start 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 -- 172.21.15.161:0/2598770696 shutdown_connections 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 -- 172.21.15.161:0/2598770696 >> 172.21.15.161:0/2598770696 conn(0x7f54a80cfd70 msgr2=0x7f54a80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 -- 172.21.15.161:0/2598770696 shutdown_connections 2023-08-10T10:29:07.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.751+0000 7f54ac8b3700 1 -- 172.21.15.161:0/2598770696 wait complete. 2023-08-10T10:29:07.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 Processor -- start 2023-08-10T10:29:07.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 -- start start 2023-08-10T10:29:07.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490006fa0 0x7f54a81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 0x7f54a81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8153cc0 con 0x7f54a8153300 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c97a0 con 0x7f5490006fa0 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.753+0000 7f54ac8b3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c9a80 con 0x7f54a80c8fc0 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59886/0 (socket says 172.21.15.161:59886) 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 -- 172.21.15.161:0/1134856667 learned_addr learned my addr 172.21.15.161:0/1134856667 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:07.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a659c700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490006fa0 0x7f54a81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a5d9b700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 0x7f54a81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 -- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 msgr2=0x7f54a81476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 0x7f54a81476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 -- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490006fa0 msgr2=0x7f54a81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490006fa0 0x7f54a81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 -- 172.21.15.161:0/1134856667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80c6f70 con 0x7f54a8153300 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a5d9b700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 0x7f54a81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54a6d9d700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54a0017040 tx=0x7f54a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0007000 con 0x7f54a8153300 2023-08-10T10:29:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0003e50 con 0x7f54a8153300 2023-08-10T10:29:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0014b50 con 0x7f54a8153300 2023-08-10T10:29:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a80c7250 con 0x7f54a8153300 2023-08-10T10:29:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.754+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80c9440 con 0x7f54a8153300 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.755+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a80c7440 con 0x7f54a8153300 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.755+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54a0024020 con 0x7f54a8153300 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.756+0000 7f5496ffd700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 0x7f548806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.756+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54a008ab70 con 0x7f54a8153300 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.756+0000 7f54a659c700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 0x7f548806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.756+0000 7f54a659c700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 0x7f548806d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f549c009b20 tx=0x7f549c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.760+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54a0055cb0 con 0x7f54a8153300 2023-08-10T10:29:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.946+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54a80712b0 con 0x7f548806ace0 2023-08-10T10:29:07.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.953+0000 7f5496ffd700 1 -- 172.21.15.161:0/1134856667 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273039 (secure 0 0 0) 0x7f549c009770 con 0x7f548806ace0 2023-08-10T10:29:07.956 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:07.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 msgr2=0x7f548806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 0x7f548806d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f549c009b20 tx=0x7f549c008040 comp rx=0 tx=0).stop 2023-08-10T10:29:07.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 msgr2=0x7f54a8153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:07.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54a0017040 tx=0x7f54a0009750 comp rx=0 tx=0).stop 2023-08-10T10:29:07.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 shutdown_connections 2023-08-10T10:29:07.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f548806ace0 0x7f548806d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54a8153300 0x7f54a8153780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490006fa0 0x7f54a81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 --2- 172.21.15.161:0/1134856667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54a80c8fc0 0x7f54a81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:07.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 >> 172.21.15.161:0/1134856667 conn(0x7f54a80cfd70 msgr2=0x7f54a80b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:07.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 shutdown_connections 2023-08-10T10:29:07.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:07.956+0000 7f54ac8b3700 1 -- 172.21.15.161:0/1134856667 wait complete. 2023-08-10T10:29:07.962 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:07.968 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-10T10:29:06.187318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":28,"acting":28,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218928,"kb_used_data":2748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755792,"statfs":{"total":773094113280,"available":772869931008,"internally_reserved":0,"allocated":2813952,"data_stored":1719254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.705932"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-10T10:28:59.302542+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:28:59.302542+0000","last_peered":"2023-08-10T10:28:59.302542+0000","last_clean":"2023-08-10T10:28:59.302542+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:28:59.302542+0000","last_undegraded":"2023-08-10T10:28:59.302542+0000","last_fullsized":"2023-08-10T10:28:59.302542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:17.452848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309083+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:28:58.309083+0000","last_peered":"2023-08-10T10:28:58.309083+0000","last_clean":"2023-08-10T10:28:58.309083+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:28:58.309083+0000","last_undegraded":"2023-08-10T10:28:58.309083+0000","last_fullsized":"2023-08-10T10:28:58.309083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:26:55.561650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309059+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:28:58.309059+0000","last_peered":"2023-08-10T10:28:58.309059+0000","last_clean":"2023-08-10T10:28:58.309059+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:28:58.309059+0000","last_undegraded":"2023-08-10T10:28:58.309059+0000","last_fullsized":"2023-08-10T10:28:58.309059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:58.183462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.299732+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:28:58.299732+0000","last_peered":"2023-08-10T10:28:58.299732+0000","last_clean":"2023-08-10T10:28:58.299732+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:28:58.299732+0000","last_undegraded":"2023-08-10T10:28:58.299732+0000","last_fullsized":"2023-08-10T10:28:58.299732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:08.027932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309295+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:28:58.309295+0000","last_peered":"2023-08-10T10:28:58.309295+0000","last_clean":"2023-08-10T10:28:58.309295+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:28:58.309295+0000","last_undegraded":"2023-08-10T10:28:58.309295+0000","last_fullsized":"2023-08-10T10:28:58.309295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:31:10.374174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.309306+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:28:58.309306+0000","last_peered":"2023-08-10T10:28:58.309306+0000","last_clean":"2023-08-10T10:28:58.309306+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:28:58.309306+0000","last_undegraded":"2023-08-10T10:28:58.309306+0000","last_fullsized":"2023-08-10T10:28:58.309306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:08.899683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-10T10:28:59.302535+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:28:59.302535+0000","last_peered":"2023-08-10T10:28:59.302535+0000","last_clean":"2023-08-10T10:28:59.302535+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:28:59.302535+0000","last_undegraded":"2023-08-10T10:28:59.302535+0000","last_fullsized":"2023-08-10T10:28:59.302535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:40.378341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-10T10:28:58.306385+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:28:58.306385+0000","last_peered":"2023-08-10T10:28:58.306385+0000","last_clean":"2023-08-10T10:28:58.306385+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:28:58.306385+0000","last_undegraded":"2023-08-10T10:28:58.306385+0000","last_fullsized":"2023-08-10T10:28:58.306385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:11.132103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:01.477025+0000","last_change":"2023-08-10T10:29:01.477025+0000","last_active":"2023-08-10T10:29:01.477025+0000","last_peered":"2023-08-10T10:29:01.477025+0000","last_clean":"2023-08-10T10:29:01.477025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:01.477025+0000","last_undegraded":"2023-08-10T10:29:01.477025+0000","last_fullsized":"2023-08-10T10:29:01.477025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:29:02.478716+0000","last_change":"2023-08-10T10:29:02.478716+0000","last_active":"2023-08-10T10:29:02.478716+0000","last_peered":"2023-08-10T10:29:02.478716+0000","last_clean":"2023-08-10T10:29:02.478716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:29:02.478716+0000","last_undegraded":"2023-08-10T10:29:02.478716+0000","last_fullsized":"2023-08-10T10:29:02.478716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":652319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:07.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:08.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.128+0000 7fbbb4613700 1 Processor -- start 2023-08-10T10:29:08.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.128+0000 7fbbb4613700 1 -- start start 2023-08-10T10:29:08.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb4613700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbbac0aea70 0x7fbbac0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb4613700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbac071940 0x7fbbac06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb4613700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0cf6a0 con 0x7fbbac06a190 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb4613700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac06eb80 con 0x7fbbac0aea70 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb4613700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0af510 con 0x7fbbac071940 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.129+0000 7fbbb1bae700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbbac0aea70 0x7fbbac0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbbac0aea70 0x7fbbac0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59892/0 (socket says 172.21.15.161:59892) 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 -- 172.21.15.161:0/1302782695 learned_addr learned my addr 172.21.15.161:0/1302782695 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb2bb0700 1 --2- 172.21.15.161:0/1302782695 >> v2:172.21.15.175:3300/0 conn(0x7fbbac071940 0x7fbbac06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 -- 172.21.15.161:0/1302782695 >> v2:172.21.15.175:3300/0 conn(0x7fbbac071940 msgr2=0x7fbbac06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 --2- 172.21.15.161:0/1302782695 >> v2:172.21.15.175:3300/0 conn(0x7fbbac071940 0x7fbbac06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 -- 172.21.15.161:0/1302782695 >> v1:172.21.15.175:6789/0 conn(0x7fbbac06a190 legacy=0x7fbbac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 -- 172.21.15.161:0/1302782695 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac06ae60 con 0x7fbbac0aea70 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb1bae700 1 --2- 172.21.15.161:0/1302782695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac0aea70 0x7fbbac0c6810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbac06c330 tx=0x7fbba8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a262a88eecc85872 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb13ad700 1 -- 172.21.15.161:0/1302782695 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8004230 con 0x7fbbac0aea70 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb13ad700 1 -- 172.21.15.161:0/1302782695 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8004390 con 0x7fbbac0aea70 2023-08-10T10:29:08.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.130+0000 7fbbb13ad700 1 -- 172.21.15.161:0/1302782695 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba80036a0 con 0x7fbbac0aea70 2023-08-10T10:29:08.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 -- 172.21.15.161:0/1302782695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac0aea70 msgr2=0x7fbbac0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 --2- 172.21.15.161:0/1302782695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac0aea70 0x7fbbac0c6810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbac06c330 tx=0x7fbba8009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 -- 172.21.15.161:0/1302782695 shutdown_connections 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 --2- 172.21.15.161:0/1302782695 >> v2:172.21.15.175:3300/0 conn(0x7fbbac071940 0x7fbbac06a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 --2- 172.21.15.161:0/1302782695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac0aea70 0x7fbbac0c6810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 -- 172.21.15.161:0/1302782695 >> 172.21.15.161:0/1302782695 conn(0x7fbbac0cfd70 msgr2=0x7fbbac0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:08.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 -- 172.21.15.161:0/1302782695 shutdown_connections 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.131+0000 7fbbb4613700 1 -- 172.21.15.161:0/1302782695 wait complete. 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.132+0000 7fbbb4613700 1 Processor -- start 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.132+0000 7fbbb4613700 1 -- start start 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbac071940 0x7fbbac141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 0x7fbbac143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac15ef90 con 0x7fbbac06a190 2023-08-10T10:29:08.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0b59c0 con 0x7fbbac0aea70 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac141a70 con 0x7fbbac071940 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59896/0 (socket says 172.21.15.161:59896) 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 -- 172.21.15.161:0/3589537973 learned_addr learned my addr 172.21.15.161:0/3589537973 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb2bb0700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 0x7fbbac143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb1bae700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbac071940 0x7fbbac141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 -- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbac071940 msgr2=0x7fbbac141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbac071940 0x7fbbac141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 -- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 msgr2=0x7fbbac143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 0x7fbbac143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 -- 172.21.15.161:0/3589537973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009550 con 0x7fbbac06a190 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb2bb0700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 0x7fbbac143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb23af700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b4d0 tx=0x7fbb9c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c011830 con 0x7fbbac06a190 2023-08-10T10:29:08.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c011990 con 0x7fbbac06a190 2023-08-10T10:29:08.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac0b5440 con 0x7fbbac06a190 2023-08-10T10:29:08.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c011d40 con 0x7fbbac06a190 2023-08-10T10:29:08.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.133+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac0b56e0 con 0x7fbbac06a190 2023-08-10T10:29:08.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.134+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac0744e0 con 0x7fbbac06a190 2023-08-10T10:29:08.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.135+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb9c01a400 con 0x7fbbac06a190 2023-08-10T10:29:08.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.135+0000 7fbba2ffd700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 0x7fbb9006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.135+0000 7fbbb1bae700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 0x7fbb9006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.135+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb9c089310 con 0x7fbbac06a190 2023-08-10T10:29:08.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.135+0000 7fbbb1bae700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 0x7fbb9006d1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0aeeb0 tx=0x7fbba8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.139+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbb9c054330 con 0x7fbbac06a190 2023-08-10T10:29:08.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.323+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbac15d520 con 0x7fbb9006ad10 2023-08-10T10:29:08.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.331+0000 7fbba2ffd700 1 -- 172.21.15.161:0/3589537973 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286797 (secure 0 0 0) 0x7fbba8020070 con 0x7fbb9006ad10 2023-08-10T10:29:08.334 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 msgr2=0x7fbb9006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 0x7fbb9006d1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0aeeb0 tx=0x7fbba8008030 comp rx=0 tx=0).stop 2023-08-10T10:29:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 msgr2=0x7fbbac15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b4d0 tx=0x7fbb9c00b890 comp rx=0 tx=0).stop 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 shutdown_connections 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbb9006ad10 0x7fbb9006d1d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac0aea70 0x7fbbac143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbac06a190 0x7fbbac15d6a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 --2- 172.21.15.161:0/3589537973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbac071940 0x7fbbac141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 >> 172.21.15.161:0/3589537973 conn(0x7fbbac0cfd70 msgr2=0x7fbbac0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 shutdown_connections 2023-08-10T10:29:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.335+0000 7fbbb4613700 1 -- 172.21.15.161:0/3589537973 wait complete. 2023-08-10T10:29:08.338 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:08.347 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-10T10:29:08.187714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219328,"kb_used_data":3148,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755392,"statfs":{"total":773094113280,"available":772869521408,"internally_reserved":0,"allocated":3223552,"data_stored":1906355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001229"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452374+0000","last_change":"2023-08-10T10:29:03.450108+0000","last_active":"2023-08-10T10:29:03.452374+0000","last_peered":"2023-08-10T10:29:03.452374+0000","last_clean":"2023-08-10T10:29:03.452374+0000","last_became_active":"2023-08-10T10:29:03.449434+0000","last_became_peered":"2023-08-10T10:29:03.449434+0000","last_unstale":"2023-08-10T10:29:03.452374+0000","last_undegraded":"2023-08-10T10:29:03.452374+0000","last_fullsized":"2023-08-10T10:29:03.452374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:46.112179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435719+0000","last_change":"2023-08-10T10:29:03.449144+0000","last_active":"2023-08-10T10:29:04.435719+0000","last_peered":"2023-08-10T10:29:04.435719+0000","last_clean":"2023-08-10T10:29:04.435719+0000","last_became_active":"2023-08-10T10:29:03.448690+0000","last_became_peered":"2023-08-10T10:29:03.448690+0000","last_unstale":"2023-08-10T10:29:04.435719+0000","last_undegraded":"2023-08-10T10:29:04.435719+0000","last_fullsized":"2023-08-10T10:29:04.435719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450284+0000","last_change":"2023-08-10T10:29:03.448973+0000","last_active":"2023-08-10T10:29:03.450284+0000","last_peered":"2023-08-10T10:29:03.450284+0000","last_clean":"2023-08-10T10:29:03.450284+0000","last_became_active":"2023-08-10T10:29:03.448666+0000","last_became_peered":"2023-08-10T10:29:03.448666+0000","last_unstale":"2023-08-10T10:29:03.450284+0000","last_undegraded":"2023-08-10T10:29:03.450284+0000","last_fullsized":"2023-08-10T10:29:03.450284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:01:44.195849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.795980+0000","last_change":"2023-08-10T10:29:03.451710+0000","last_active":"2023-08-10T10:29:04.795980+0000","last_peered":"2023-08-10T10:29:04.795980+0000","last_clean":"2023-08-10T10:29:04.795980+0000","last_became_active":"2023-08-10T10:29:03.451411+0000","last_became_peered":"2023-08-10T10:29:03.451411+0000","last_unstale":"2023-08-10T10:29:04.795980+0000","last_undegraded":"2023-08-10T10:29:04.795980+0000","last_fullsized":"2023-08-10T10:29:04.795980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435794+0000","last_change":"2023-08-10T10:29:03.451672+0000","last_active":"2023-08-10T10:29:04.435794+0000","last_peered":"2023-08-10T10:29:04.435794+0000","last_clean":"2023-08-10T10:29:04.435794+0000","last_became_active":"2023-08-10T10:29:03.451376+0000","last_became_peered":"2023-08-10T10:29:03.451376+0000","last_unstale":"2023-08-10T10:29:04.435794+0000","last_undegraded":"2023-08-10T10:29:04.435794+0000","last_fullsized":"2023-08-10T10:29:04.435794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440823+0000","last_change":"2023-08-10T10:29:03.444231+0000","last_active":"2023-08-10T10:29:04.440823+0000","last_peered":"2023-08-10T10:29:04.440823+0000","last_clean":"2023-08-10T10:29:04.440823+0000","last_became_active":"2023-08-10T10:29:03.443264+0000","last_became_peered":"2023-08-10T10:29:03.443264+0000","last_unstale":"2023-08-10T10:29:04.440823+0000","last_undegraded":"2023-08-10T10:29:04.440823+0000","last_fullsized":"2023-08-10T10:29:04.440823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.451713+0000","last_change":"2023-08-10T10:29:03.447620+0000","last_active":"2023-08-10T10:29:03.451713+0000","last_peered":"2023-08-10T10:29:03.451713+0000","last_clean":"2023-08-10T10:29:03.451713+0000","last_became_active":"2023-08-10T10:29:03.447339+0000","last_became_peered":"2023-08-10T10:29:03.447339+0000","last_unstale":"2023-08-10T10:29:03.451713+0000","last_undegraded":"2023-08-10T10:29:03.451713+0000","last_fullsized":"2023-08-10T10:29:03.451713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796204+0000","last_change":"2023-08-10T10:29:03.450118+0000","last_active":"2023-08-10T10:29:04.796204+0000","last_peered":"2023-08-10T10:29:04.796204+0000","last_clean":"2023-08-10T10:29:04.796204+0000","last_became_active":"2023-08-10T10:29:03.449864+0000","last_became_peered":"2023-08-10T10:29:03.449864+0000","last_unstale":"2023-08-10T10:29:04.796204+0000","last_undegraded":"2023-08-10T10:29:04.796204+0000","last_fullsized":"2023-08-10T10:29:04.796204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452711+0000","last_change":"2023-08-10T10:29:03.451715+0000","last_active":"2023-08-10T10:29:03.452711+0000","last_peered":"2023-08-10T10:29:03.452711+0000","last_clean":"2023-08-10T10:29:03.452711+0000","last_became_active":"2023-08-10T10:29:03.451414+0000","last_became_peered":"2023-08-10T10:29:03.451414+0000","last_unstale":"2023-08-10T10:29:03.452711+0000","last_undegraded":"2023-08-10T10:29:03.452711+0000","last_fullsized":"2023-08-10T10:29:03.452711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:14.287109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435674+0000","last_change":"2023-08-10T10:29:03.443457+0000","last_active":"2023-08-10T10:29:04.435674+0000","last_peered":"2023-08-10T10:29:04.435674+0000","last_clean":"2023-08-10T10:29:04.435674+0000","last_became_active":"2023-08-10T10:29:03.443182+0000","last_became_peered":"2023-08-10T10:29:03.443182+0000","last_unstale":"2023-08-10T10:29:04.435674+0000","last_undegraded":"2023-08-10T10:29:04.435674+0000","last_fullsized":"2023-08-10T10:29:04.435674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452220+0000","last_change":"2023-08-10T10:29:03.448673+0000","last_active":"2023-08-10T10:29:03.452220+0000","last_peered":"2023-08-10T10:29:03.452220+0000","last_clean":"2023-08-10T10:29:03.452220+0000","last_became_active":"2023-08-10T10:29:03.448378+0000","last_became_peered":"2023-08-10T10:29:03.448378+0000","last_unstale":"2023-08-10T10:29:03.452220+0000","last_undegraded":"2023-08-10T10:29:03.452220+0000","last_fullsized":"2023-08-10T10:29:03.452220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441146+0000","last_change":"2023-08-10T10:29:03.445496+0000","last_active":"2023-08-10T10:29:04.441146+0000","last_peered":"2023-08-10T10:29:04.441146+0000","last_clean":"2023-08-10T10:29:04.441146+0000","last_became_active":"2023-08-10T10:29:03.445239+0000","last_became_peered":"2023-08-10T10:29:03.445239+0000","last_unstale":"2023-08-10T10:29:04.441146+0000","last_undegraded":"2023-08-10T10:29:04.441146+0000","last_fullsized":"2023-08-10T10:29:04.441146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:50.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.451219+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.450957+0000","last_became_peered":"2023-08-10T10:29:03.450957+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:22.072828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796266+0000","last_change":"2023-08-10T10:29:03.450677+0000","last_active":"2023-08-10T10:29:04.796266+0000","last_peered":"2023-08-10T10:29:04.796266+0000","last_clean":"2023-08-10T10:29:04.796266+0000","last_became_active":"2023-08-10T10:29:03.450414+0000","last_became_peered":"2023-08-10T10:29:03.450414+0000","last_unstale":"2023-08-10T10:29:04.796266+0000","last_undegraded":"2023-08-10T10:29:04.796266+0000","last_fullsized":"2023-08-10T10:29:04.796266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435726+0000","last_change":"2023-08-10T10:29:03.448733+0000","last_active":"2023-08-10T10:29:04.435726+0000","last_peered":"2023-08-10T10:29:04.435726+0000","last_clean":"2023-08-10T10:29:04.435726+0000","last_became_active":"2023-08-10T10:29:03.448379+0000","last_became_peered":"2023-08-10T10:29:03.448379+0000","last_unstale":"2023-08-10T10:29:04.435726+0000","last_undegraded":"2023-08-10T10:29:04.435726+0000","last_fullsized":"2023-08-10T10:29:04.435726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435953+0000","last_change":"2023-08-10T10:29:03.442226+0000","last_active":"2023-08-10T10:29:04.435953+0000","last_peered":"2023-08-10T10:29:04.435953+0000","last_clean":"2023-08-10T10:29:04.435953+0000","last_became_active":"2023-08-10T10:29:03.441986+0000","last_became_peered":"2023-08-10T10:29:03.441986+0000","last_unstale":"2023-08-10T10:29:04.435953+0000","last_undegraded":"2023-08-10T10:29:04.435953+0000","last_fullsized":"2023-08-10T10:29:04.435953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441131+0000","last_change":"2023-08-10T10:29:03.447854+0000","last_active":"2023-08-10T10:29:04.441131+0000","last_peered":"2023-08-10T10:29:04.441131+0000","last_clean":"2023-08-10T10:29:04.441131+0000","last_became_active":"2023-08-10T10:29:03.447513+0000","last_became_peered":"2023-08-10T10:29:03.447513+0000","last_unstale":"2023-08-10T10:29:04.441131+0000","last_undegraded":"2023-08-10T10:29:04.441131+0000","last_fullsized":"2023-08-10T10:29:04.441131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796072+0000","last_change":"2023-08-10T10:29:03.450633+0000","last_active":"2023-08-10T10:29:04.796072+0000","last_peered":"2023-08-10T10:29:04.796072+0000","last_clean":"2023-08-10T10:29:04.796072+0000","last_became_active":"2023-08-10T10:29:03.450345+0000","last_became_peered":"2023-08-10T10:29:03.450345+0000","last_unstale":"2023-08-10T10:29:04.796072+0000","last_undegraded":"2023-08-10T10:29:04.796072+0000","last_fullsized":"2023-08-10T10:29:04.796072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086320+0000","last_change":"2023-08-10T10:29:03.451595+0000","last_active":"2023-08-10T10:29:06.086320+0000","last_peered":"2023-08-10T10:29:06.086320+0000","last_clean":"2023-08-10T10:29:06.086320+0000","last_became_active":"2023-08-10T10:29:03.451277+0000","last_became_peered":"2023-08-10T10:29:03.451277+0000","last_unstale":"2023-08-10T10:29:06.086320+0000","last_undegraded":"2023-08-10T10:29:06.086320+0000","last_fullsized":"2023-08-10T10:29:06.086320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440927+0000","last_change":"2023-08-10T10:29:03.448073+0000","last_active":"2023-08-10T10:29:04.440927+0000","last_peered":"2023-08-10T10:29:04.440927+0000","last_clean":"2023-08-10T10:29:04.440927+0000","last_became_active":"2023-08-10T10:29:03.447608+0000","last_became_peered":"2023-08-10T10:29:03.447608+0000","last_unstale":"2023-08-10T10:29:04.440927+0000","last_undegraded":"2023-08-10T10:29:04.440927+0000","last_fullsized":"2023-08-10T10:29:04.440927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.448239+0000","last_change":"2023-08-10T10:29:03.444304+0000","last_active":"2023-08-10T10:29:03.448239+0000","last_peered":"2023-08-10T10:29:03.448239+0000","last_clean":"2023-08-10T10:29:03.448239+0000","last_became_active":"2023-08-10T10:29:03.441797+0000","last_became_peered":"2023-08-10T10:29:03.441797+0000","last_unstale":"2023-08-10T10:29:03.448239+0000","last_undegraded":"2023-08-10T10:29:03.448239+0000","last_fullsized":"2023-08-10T10:29:03.448239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453594+0000","last_change":"2023-08-10T10:29:03.448858+0000","last_active":"2023-08-10T10:29:03.453594+0000","last_peered":"2023-08-10T10:29:03.453594+0000","last_clean":"2023-08-10T10:29:03.453594+0000","last_became_active":"2023-08-10T10:29:03.448575+0000","last_became_peered":"2023-08-10T10:29:03.448575+0000","last_unstale":"2023-08-10T10:29:03.453594+0000","last_undegraded":"2023-08-10T10:29:03.453594+0000","last_fullsized":"2023-08-10T10:29:03.453594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:46.112179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452325+0000","last_change":"2023-08-10T10:29:03.449820+0000","last_active":"2023-08-10T10:29:03.452325+0000","last_peered":"2023-08-10T10:29:03.452325+0000","last_clean":"2023-08-10T10:29:03.452325+0000","last_became_active":"2023-08-10T10:29:03.449280+0000","last_became_peered":"2023-08-10T10:29:03.449280+0000","last_unstale":"2023-08-10T10:29:03.452325+0000","last_undegraded":"2023-08-10T10:29:03.452325+0000","last_fullsized":"2023-08-10T10:29:03.452325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:43.080354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436273+0000","last_change":"2023-08-10T10:29:02.509556+0000","last_active":"2023-08-10T10:29:04.436273+0000","last_peered":"2023-08-10T10:29:04.436273+0000","last_clean":"2023-08-10T10:29:04.436273+0000","last_became_active":"2023-08-10T10:29:02.509283+0000","last_became_peered":"2023-08-10T10:29:02.509283+0000","last_unstale":"2023-08-10T10:29:04.436273+0000","last_undegraded":"2023-08-10T10:29:04.436273+0000","last_fullsized":"2023-08-10T10:29:04.436273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086441+0000","last_change":"2023-08-10T10:29:03.443570+0000","last_active":"2023-08-10T10:29:06.086441+0000","last_peered":"2023-08-10T10:29:06.086441+0000","last_clean":"2023-08-10T10:29:06.086441+0000","last_became_active":"2023-08-10T10:29:03.443302+0000","last_became_peered":"2023-08-10T10:29:03.443302+0000","last_unstale":"2023-08-10T10:29:06.086441+0000","last_undegraded":"2023-08-10T10:29:06.086441+0000","last_fullsized":"2023-08-10T10:29:06.086441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440254+0000","last_change":"2023-08-10T10:29:02.510076+0000","last_active":"2023-08-10T10:29:03.440254+0000","last_peered":"2023-08-10T10:29:03.440254+0000","last_clean":"2023-08-10T10:29:03.440254+0000","last_became_active":"2023-08-10T10:29:02.509806+0000","last_became_peered":"2023-08-10T10:29:02.509806+0000","last_unstale":"2023-08-10T10:29:03.440254+0000","last_undegraded":"2023-08-10T10:29:03.440254+0000","last_fullsized":"2023-08-10T10:29:03.440254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:37.593152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796264+0000","last_change":"2023-08-10T10:29:03.450711+0000","last_active":"2023-08-10T10:29:04.796264+0000","last_peered":"2023-08-10T10:29:04.796264+0000","last_clean":"2023-08-10T10:29:04.796264+0000","last_became_active":"2023-08-10T10:29:03.450363+0000","last_became_peered":"2023-08-10T10:29:03.450363+0000","last_unstale":"2023-08-10T10:29:04.796264+0000","last_undegraded":"2023-08-10T10:29:04.796264+0000","last_fullsized":"2023-08-10T10:29:04.796264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086179+0000","last_change":"2023-08-10T10:29:02.509352+0000","last_active":"2023-08-10T10:29:06.086179+0000","last_peered":"2023-08-10T10:29:06.086179+0000","last_clean":"2023-08-10T10:29:06.086179+0000","last_became_active":"2023-08-10T10:29:02.509050+0000","last_became_peered":"2023-08-10T10:29:02.509050+0000","last_unstale":"2023-08-10T10:29:06.086179+0000","last_undegraded":"2023-08-10T10:29:06.086179+0000","last_fullsized":"2023-08-10T10:29:06.086179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:03.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450859+0000","last_change":"2023-08-10T10:29:03.449521+0000","last_active":"2023-08-10T10:29:03.450859+0000","last_peered":"2023-08-10T10:29:03.450859+0000","last_clean":"2023-08-10T10:29:03.450859+0000","last_became_active":"2023-08-10T10:29:03.449254+0000","last_became_peered":"2023-08-10T10:29:03.449254+0000","last_unstale":"2023-08-10T10:29:03.450859+0000","last_undegraded":"2023-08-10T10:29:03.450859+0000","last_fullsized":"2023-08-10T10:29:03.450859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:40.447090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796291+0000","last_change":"2023-08-10T10:29:02.514169+0000","last_active":"2023-08-10T10:29:04.796291+0000","last_peered":"2023-08-10T10:29:04.796291+0000","last_clean":"2023-08-10T10:29:04.796291+0000","last_became_active":"2023-08-10T10:29:02.513967+0000","last_became_peered":"2023-08-10T10:29:02.513967+0000","last_unstale":"2023-08-10T10:29:04.796291+0000","last_undegraded":"2023-08-10T10:29:04.796291+0000","last_fullsized":"2023-08-10T10:29:04.796291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086126+0000","last_change":"2023-08-10T10:29:03.440626+0000","last_active":"2023-08-10T10:29:06.086126+0000","last_peered":"2023-08-10T10:29:06.086126+0000","last_clean":"2023-08-10T10:29:06.086126+0000","last_became_active":"2023-08-10T10:29:03.440266+0000","last_became_peered":"2023-08-10T10:29:03.440266+0000","last_unstale":"2023-08-10T10:29:06.086126+0000","last_undegraded":"2023-08-10T10:29:06.086126+0000","last_fullsized":"2023-08-10T10:29:06.086126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.445499+0000","last_change":"2023-08-10T10:29:02.505024+0000","last_active":"2023-08-10T10:29:03.445499+0000","last_peered":"2023-08-10T10:29:03.445499+0000","last_clean":"2023-08-10T10:29:03.445499+0000","last_became_active":"2023-08-10T10:29:02.504178+0000","last_became_peered":"2023-08-10T10:29:02.504178+0000","last_unstale":"2023-08-10T10:29:03.445499+0000","last_undegraded":"2023-08-10T10:29:03.445499+0000","last_fullsized":"2023-08-10T10:29:03.445499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:37.593152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086183+0000","last_change":"2023-08-10T10:29:03.444252+0000","last_active":"2023-08-10T10:29:06.086183+0000","last_peered":"2023-08-10T10:29:06.086183+0000","last_clean":"2023-08-10T10:29:06.086183+0000","last_became_active":"2023-08-10T10:29:03.443982+0000","last_became_peered":"2023-08-10T10:29:03.443982+0000","last_unstale":"2023-08-10T10:29:06.086183+0000","last_undegraded":"2023-08-10T10:29:06.086183+0000","last_fullsized":"2023-08-10T10:29:06.086183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441209+0000","last_change":"2023-08-10T10:29:02.510256+0000","last_active":"2023-08-10T10:29:04.441209+0000","last_peered":"2023-08-10T10:29:04.441209+0000","last_clean":"2023-08-10T10:29:04.441209+0000","last_became_active":"2023-08-10T10:29:02.510054+0000","last_became_peered":"2023-08-10T10:29:02.510054+0000","last_unstale":"2023-08-10T10:29:04.441209+0000","last_undegraded":"2023-08-10T10:29:04.441209+0000","last_fullsized":"2023-08-10T10:29:04.441209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:03.509285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.448669+0000","last_change":"2023-08-10T10:29:03.442886+0000","last_active":"2023-08-10T10:29:03.448669+0000","last_peered":"2023-08-10T10:29:03.448669+0000","last_clean":"2023-08-10T10:29:03.448669+0000","last_became_active":"2023-08-10T10:29:03.442103+0000","last_became_peered":"2023-08-10T10:29:03.442103+0000","last_unstale":"2023-08-10T10:29:03.448669+0000","last_undegraded":"2023-08-10T10:29:03.448669+0000","last_fullsized":"2023-08-10T10:29:03.448669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436220+0000","last_change":"2023-08-10T10:29:02.504354+0000","last_active":"2023-08-10T10:29:04.436220+0000","last_peered":"2023-08-10T10:29:04.436220+0000","last_clean":"2023-08-10T10:29:04.436220+0000","last_became_active":"2023-08-10T10:29:02.503879+0000","last_became_peered":"2023-08-10T10:29:02.503879+0000","last_unstale":"2023-08-10T10:29:04.436220+0000","last_undegraded":"2023-08-10T10:29:04.436220+0000","last_fullsized":"2023-08-10T10:29:04.436220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436378+0000","last_change":"2023-08-10T10:29:03.440803+0000","last_active":"2023-08-10T10:29:04.436378+0000","last_peered":"2023-08-10T10:29:04.436378+0000","last_clean":"2023-08-10T10:29:04.436378+0000","last_became_active":"2023-08-10T10:29:03.440491+0000","last_became_peered":"2023-08-10T10:29:03.440491+0000","last_unstale":"2023-08-10T10:29:04.436378+0000","last_undegraded":"2023-08-10T10:29:04.436378+0000","last_fullsized":"2023-08-10T10:29:04.436378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:04.510976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441036+0000","last_change":"2023-08-10T10:29:02.506354+0000","last_active":"2023-08-10T10:29:04.441036+0000","last_peered":"2023-08-10T10:29:04.441036+0000","last_clean":"2023-08-10T10:29:04.441036+0000","last_became_active":"2023-08-10T10:29:02.506110+0000","last_became_peered":"2023-08-10T10:29:02.506110+0000","last_unstale":"2023-08-10T10:29:04.441036+0000","last_undegraded":"2023-08-10T10:29:04.441036+0000","last_fullsized":"2023-08-10T10:29:04.441036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.953593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086288+0000","last_change":"2023-08-10T10:29:03.443853+0000","last_active":"2023-08-10T10:29:06.086288+0000","last_peered":"2023-08-10T10:29:06.086288+0000","last_clean":"2023-08-10T10:29:06.086288+0000","last_became_active":"2023-08-10T10:29:03.443591+0000","last_became_peered":"2023-08-10T10:29:03.443591+0000","last_unstale":"2023-08-10T10:29:06.086288+0000","last_undegraded":"2023-08-10T10:29:06.086288+0000","last_fullsized":"2023-08-10T10:29:06.086288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796014+0000","last_change":"2023-08-10T10:29:02.508938+0000","last_active":"2023-08-10T10:29:04.796014+0000","last_peered":"2023-08-10T10:29:04.796014+0000","last_clean":"2023-08-10T10:29:04.796014+0000","last_became_active":"2023-08-10T10:29:02.508669+0000","last_became_peered":"2023-08-10T10:29:02.508669+0000","last_unstale":"2023-08-10T10:29:04.796014+0000","last_undegraded":"2023-08-10T10:29:04.796014+0000","last_fullsized":"2023-08-10T10:29:04.796014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452381+0000","last_change":"2023-08-10T10:29:03.450335+0000","last_active":"2023-08-10T10:29:03.452381+0000","last_peered":"2023-08-10T10:29:03.452381+0000","last_clean":"2023-08-10T10:29:03.452381+0000","last_became_active":"2023-08-10T10:29:03.449118+0000","last_became_peered":"2023-08-10T10:29:03.449118+0000","last_unstale":"2023-08-10T10:29:03.452381+0000","last_undegraded":"2023-08-10T10:29:03.452381+0000","last_fullsized":"2023-08-10T10:29:03.452381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:59.873158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440904+0000","last_change":"2023-08-10T10:29:02.508190+0000","last_active":"2023-08-10T10:29:04.440904+0000","last_peered":"2023-08-10T10:29:04.440904+0000","last_clean":"2023-08-10T10:29:04.440904+0000","last_became_active":"2023-08-10T10:29:02.507882+0000","last_became_peered":"2023-08-10T10:29:02.507882+0000","last_unstale":"2023-08-10T10:29:04.440904+0000","last_undegraded":"2023-08-10T10:29:04.440904+0000","last_fullsized":"2023-08-10T10:29:04.440904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796210+0000","last_change":"2023-08-10T10:29:03.448316+0000","last_active":"2023-08-10T10:29:04.796210+0000","last_peered":"2023-08-10T10:29:04.796210+0000","last_clean":"2023-08-10T10:29:04.796210+0000","last_became_active":"2023-08-10T10:29:03.447711+0000","last_became_peered":"2023-08-10T10:29:03.447711+0000","last_unstale":"2023-08-10T10:29:04.796210+0000","last_undegraded":"2023-08-10T10:29:04.796210+0000","last_fullsized":"2023-08-10T10:29:04.796210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.500514+0000","last_change":"2023-08-10T10:29:02.508683+0000","last_active":"2023-08-10T10:29:03.500514+0000","last_peered":"2023-08-10T10:29:03.500514+0000","last_clean":"2023-08-10T10:29:03.500514+0000","last_became_active":"2023-08-10T10:29:02.508399+0000","last_became_peered":"2023-08-10T10:29:02.508399+0000","last_unstale":"2023-08-10T10:29:03.500514+0000","last_undegraded":"2023-08-10T10:29:03.500514+0000","last_fullsized":"2023-08-10T10:29:03.500514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:02.781878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086773+0000","last_change":"2023-08-10T10:29:03.444878+0000","last_active":"2023-08-10T10:29:06.086773+0000","last_peered":"2023-08-10T10:29:06.086773+0000","last_clean":"2023-08-10T10:29:06.086773+0000","last_became_active":"2023-08-10T10:29:03.444560+0000","last_became_peered":"2023-08-10T10:29:03.444560+0000","last_unstale":"2023-08-10T10:29:06.086773+0000","last_undegraded":"2023-08-10T10:29:06.086773+0000","last_fullsized":"2023-08-10T10:29:06.086773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441325+0000","last_change":"2023-08-10T10:29:02.506132+0000","last_active":"2023-08-10T10:29:04.441325+0000","last_peered":"2023-08-10T10:29:04.441325+0000","last_clean":"2023-08-10T10:29:04.441325+0000","last_became_active":"2023-08-10T10:29:02.505862+0000","last_became_peered":"2023-08-10T10:29:02.505862+0000","last_unstale":"2023-08-10T10:29:04.441325+0000","last_undegraded":"2023-08-10T10:29:04.441325+0000","last_fullsized":"2023-08-10T10:29:04.441325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:53.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452252+0000","last_change":"2023-08-10T10:29:03.448717+0000","last_active":"2023-08-10T10:29:03.452252+0000","last_peered":"2023-08-10T10:29:03.452252+0000","last_clean":"2023-08-10T10:29:03.452252+0000","last_became_active":"2023-08-10T10:29:03.448231+0000","last_became_peered":"2023-08-10T10:29:03.448231+0000","last_unstale":"2023-08-10T10:29:03.452252+0000","last_undegraded":"2023-08-10T10:29:03.452252+0000","last_fullsized":"2023-08-10T10:29:03.452252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441232+0000","last_change":"2023-08-10T10:29:02.503467+0000","last_active":"2023-08-10T10:29:04.441232+0000","last_peered":"2023-08-10T10:29:04.441232+0000","last_clean":"2023-08-10T10:29:04.441232+0000","last_became_active":"2023-08-10T10:29:02.503095+0000","last_became_peered":"2023-08-10T10:29:02.503095+0000","last_unstale":"2023-08-10T10:29:04.441232+0000","last_undegraded":"2023-08-10T10:29:04.441232+0000","last_fullsized":"2023-08-10T10:29:04.441232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:52.156146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.443580+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.443304+0000","last_became_peered":"2023-08-10T10:29:03.443304+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441314+0000","last_change":"2023-08-10T10:29:02.508008+0000","last_active":"2023-08-10T10:29:04.441314+0000","last_peered":"2023-08-10T10:29:04.441314+0000","last_clean":"2023-08-10T10:29:04.441314+0000","last_became_active":"2023-08-10T10:29:02.507657+0000","last_became_peered":"2023-08-10T10:29:02.507657+0000","last_unstale":"2023-08-10T10:29:04.441314+0000","last_undegraded":"2023-08-10T10:29:04.441314+0000","last_fullsized":"2023-08-10T10:29:04.441314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:55.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.443016+0000","last_change":"2023-08-10T10:29:03.440621+0000","last_active":"2023-08-10T10:29:03.443016+0000","last_peered":"2023-08-10T10:29:03.443016+0000","last_clean":"2023-08-10T10:29:03.443016+0000","last_became_active":"2023-08-10T10:29:03.440332+0000","last_became_peered":"2023-08-10T10:29:03.440332+0000","last_unstale":"2023-08-10T10:29:03.443016+0000","last_undegraded":"2023-08-10T10:29:03.443016+0000","last_fullsized":"2023-08-10T10:29:03.443016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:23.255768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.444703+0000","last_change":"2023-08-10T10:29:02.509818+0000","last_active":"2023-08-10T10:29:03.444703+0000","last_peered":"2023-08-10T10:29:03.444703+0000","last_clean":"2023-08-10T10:29:03.444703+0000","last_became_active":"2023-08-10T10:29:02.509518+0000","last_became_peered":"2023-08-10T10:29:02.509518+0000","last_unstale":"2023-08-10T10:29:03.444703+0000","last_undegraded":"2023-08-10T10:29:03.444703+0000","last_fullsized":"2023-08-10T10:29:03.444703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:55.437397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796348+0000","last_change":"2023-08-10T10:29:03.447884+0000","last_active":"2023-08-10T10:29:04.796348+0000","last_peered":"2023-08-10T10:29:04.796348+0000","last_clean":"2023-08-10T10:29:04.796348+0000","last_became_active":"2023-08-10T10:29:03.447609+0000","last_became_peered":"2023-08-10T10:29:03.447609+0000","last_unstale":"2023-08-10T10:29:04.796348+0000","last_undegraded":"2023-08-10T10:29:04.796348+0000","last_fullsized":"2023-08-10T10:29:04.796348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086361+0000","last_change":"2023-08-10T10:29:02.508827+0000","last_active":"2023-08-10T10:29:06.086361+0000","last_peered":"2023-08-10T10:29:06.086361+0000","last_clean":"2023-08-10T10:29:06.086361+0000","last_became_active":"2023-08-10T10:29:02.508532+0000","last_became_peered":"2023-08-10T10:29:02.508532+0000","last_unstale":"2023-08-10T10:29:06.086361+0000","last_undegraded":"2023-08-10T10:29:06.086361+0000","last_fullsized":"2023-08-10T10:29:06.086361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436080+0000","last_change":"2023-08-10T10:29:03.442543+0000","last_active":"2023-08-10T10:29:04.436080+0000","last_peered":"2023-08-10T10:29:04.436080+0000","last_clean":"2023-08-10T10:29:04.436080+0000","last_became_active":"2023-08-10T10:29:03.439760+0000","last_became_peered":"2023-08-10T10:29:03.439760+0000","last_unstale":"2023-08-10T10:29:04.436080+0000","last_undegraded":"2023-08-10T10:29:04.436080+0000","last_fullsized":"2023-08-10T10:29:04.436080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.436353+0000","last_change":"2023-08-10T10:29:02.511617+0000","last_active":"2023-08-10T10:29:03.436353+0000","last_peered":"2023-08-10T10:29:03.436353+0000","last_clean":"2023-08-10T10:29:03.436353+0000","last_became_active":"2023-08-10T10:29:02.511332+0000","last_became_peered":"2023-08-10T10:29:02.511332+0000","last_unstale":"2023-08-10T10:29:03.436353+0000","last_undegraded":"2023-08-10T10:29:03.436353+0000","last_fullsized":"2023-08-10T10:29:03.436353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:54.612454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435889+0000","last_change":"2023-08-10T10:29:03.438600+0000","last_active":"2023-08-10T10:29:04.435889+0000","last_peered":"2023-08-10T10:29:04.435889+0000","last_clean":"2023-08-10T10:29:04.435889+0000","last_became_active":"2023-08-10T10:29:03.438329+0000","last_became_peered":"2023-08-10T10:29:03.438329+0000","last_unstale":"2023-08-10T10:29:04.435889+0000","last_undegraded":"2023-08-10T10:29:04.435889+0000","last_fullsized":"2023-08-10T10:29:04.435889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435725+0000","last_change":"2023-08-10T10:29:02.501143+0000","last_active":"2023-08-10T10:29:04.435725+0000","last_peered":"2023-08-10T10:29:04.435725+0000","last_clean":"2023-08-10T10:29:04.435725+0000","last_became_active":"2023-08-10T10:29:02.500734+0000","last_became_peered":"2023-08-10T10:29:02.500734+0000","last_unstale":"2023-08-10T10:29:04.435725+0000","last_undegraded":"2023-08-10T10:29:04.435725+0000","last_fullsized":"2023-08-10T10:29:04.435725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435945+0000","last_change":"2023-08-10T10:29:03.441585+0000","last_active":"2023-08-10T10:29:04.435945+0000","last_peered":"2023-08-10T10:29:04.435945+0000","last_clean":"2023-08-10T10:29:04.435945+0000","last_became_active":"2023-08-10T10:29:03.441315+0000","last_became_peered":"2023-08-10T10:29:03.441315+0000","last_unstale":"2023-08-10T10:29:04.435945+0000","last_undegraded":"2023-08-10T10:29:04.435945+0000","last_fullsized":"2023-08-10T10:29:04.435945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086015+0000","last_change":"2023-08-10T10:29:02.509843+0000","last_active":"2023-08-10T10:29:06.086015+0000","last_peered":"2023-08-10T10:29:06.086015+0000","last_clean":"2023-08-10T10:29:06.086015+0000","last_became_active":"2023-08-10T10:29:02.509581+0000","last_became_peered":"2023-08-10T10:29:02.509581+0000","last_unstale":"2023-08-10T10:29:06.086015+0000","last_undegraded":"2023-08-10T10:29:06.086015+0000","last_fullsized":"2023-08-10T10:29:06.086015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453531+0000","last_change":"2023-08-10T10:29:03.447663+0000","last_active":"2023-08-10T10:29:03.453531+0000","last_peered":"2023-08-10T10:29:03.453531+0000","last_clean":"2023-08-10T10:29:03.453531+0000","last_became_active":"2023-08-10T10:29:03.447249+0000","last_became_peered":"2023-08-10T10:29:03.447249+0000","last_unstale":"2023-08-10T10:29:03.453531+0000","last_undegraded":"2023-08-10T10:29:03.453531+0000","last_fullsized":"2023-08-10T10:29:03.453531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:33.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440129+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:03.440129+0000","last_peered":"2023-08-10T10:29:03.440129+0000","last_clean":"2023-08-10T10:29:03.440129+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:03.440129+0000","last_undegraded":"2023-08-10T10:29:03.440129+0000","last_fullsized":"2023-08-10T10:29:03.440129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:37.893295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.446160+0000","last_change":"2023-08-10T10:29:02.509950+0000","last_active":"2023-08-10T10:29:03.446160+0000","last_peered":"2023-08-10T10:29:03.446160+0000","last_clean":"2023-08-10T10:29:03.446160+0000","last_became_active":"2023-08-10T10:29:02.509612+0000","last_became_peered":"2023-08-10T10:29:02.509612+0000","last_unstale":"2023-08-10T10:29:03.446160+0000","last_undegraded":"2023-08-10T10:29:03.446160+0000","last_fullsized":"2023-08-10T10:29:03.446160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453570+0000","last_change":"2023-08-10T10:29:03.448544+0000","last_active":"2023-08-10T10:29:03.453570+0000","last_peered":"2023-08-10T10:29:03.453570+0000","last_clean":"2023-08-10T10:29:03.453570+0000","last_became_active":"2023-08-10T10:29:03.448140+0000","last_became_peered":"2023-08-10T10:29:03.448140+0000","last_unstale":"2023-08-10T10:29:03.453570+0000","last_undegraded":"2023-08-10T10:29:03.453570+0000","last_fullsized":"2023-08-10T10:29:03.453570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.444473+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:03.444473+0000","last_peered":"2023-08-10T10:29:03.444473+0000","last_clean":"2023-08-10T10:29:03.444473+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:03.444473+0000","last_undegraded":"2023-08-10T10:29:03.444473+0000","last_fullsized":"2023-08-10T10:29:03.444473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:46.819328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436302+0000","last_change":"2023-08-10T10:29:02.508916+0000","last_active":"2023-08-10T10:29:04.436302+0000","last_peered":"2023-08-10T10:29:04.436302+0000","last_clean":"2023-08-10T10:29:04.436302+0000","last_became_active":"2023-08-10T10:29:02.508630+0000","last_became_peered":"2023-08-10T10:29:02.508630+0000","last_unstale":"2023-08-10T10:29:04.436302+0000","last_undegraded":"2023-08-10T10:29:04.436302+0000","last_fullsized":"2023-08-10T10:29:04.436302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:28.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453648+0000","last_change":"2023-08-10T10:29:03.449910+0000","last_active":"2023-08-10T10:29:03.453648+0000","last_peered":"2023-08-10T10:29:03.453648+0000","last_clean":"2023-08-10T10:29:03.453648+0000","last_became_active":"2023-08-10T10:29:03.449231+0000","last_became_peered":"2023-08-10T10:29:03.449231+0000","last_unstale":"2023-08-10T10:29:03.453648+0000","last_undegraded":"2023-08-10T10:29:03.453648+0000","last_fullsized":"2023-08-10T10:29:03.453648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.439045+0000","last_change":"2023-08-10T10:29:02.506926+0000","last_active":"2023-08-10T10:29:03.439045+0000","last_peered":"2023-08-10T10:29:03.439045+0000","last_clean":"2023-08-10T10:29:03.439045+0000","last_became_active":"2023-08-10T10:29:02.506687+0000","last_became_peered":"2023-08-10T10:29:02.506687+0000","last_unstale":"2023-08-10T10:29:03.439045+0000","last_undegraded":"2023-08-10T10:29:03.439045+0000","last_fullsized":"2023-08-10T10:29:03.439045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:54:58.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453781+0000","last_change":"2023-08-10T10:29:03.450582+0000","last_active":"2023-08-10T10:29:03.453781+0000","last_peered":"2023-08-10T10:29:03.453781+0000","last_clean":"2023-08-10T10:29:03.453781+0000","last_became_active":"2023-08-10T10:29:03.450087+0000","last_became_peered":"2023-08-10T10:29:03.450087+0000","last_unstale":"2023-08-10T10:29:03.453781+0000","last_undegraded":"2023-08-10T10:29:03.453781+0000","last_fullsized":"2023-08-10T10:29:03.453781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.438769+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:03.438769+0000","last_peered":"2023-08-10T10:29:03.438769+0000","last_clean":"2023-08-10T10:29:03.438769+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:03.438769+0000","last_undegraded":"2023-08-10T10:29:03.438769+0000","last_fullsized":"2023-08-10T10:29:03.438769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440678+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:04.440678+0000","last_peered":"2023-08-10T10:29:04.440678+0000","last_clean":"2023-08-10T10:29:04.440678+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:04.440678+0000","last_undegraded":"2023-08-10T10:29:04.440678+0000","last_fullsized":"2023-08-10T10:29:04.440678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:15.475871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086186+0000","last_change":"2023-08-10T10:29:02.509636+0000","last_active":"2023-08-10T10:29:06.086186+0000","last_peered":"2023-08-10T10:29:06.086186+0000","last_clean":"2023-08-10T10:29:06.086186+0000","last_became_active":"2023-08-10T10:29:02.509357+0000","last_became_peered":"2023-08-10T10:29:02.509357+0000","last_unstale":"2023-08-10T10:29:06.086186+0000","last_undegraded":"2023-08-10T10:29:06.086186+0000","last_fullsized":"2023-08-10T10:29:06.086186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:10.904417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.445502+0000","last_change":"2023-08-10T10:29:03.443731+0000","last_active":"2023-08-10T10:29:03.445502+0000","last_peered":"2023-08-10T10:29:03.445502+0000","last_clean":"2023-08-10T10:29:03.445502+0000","last_became_active":"2023-08-10T10:29:03.443369+0000","last_became_peered":"2023-08-10T10:29:03.443369+0000","last_unstale":"2023-08-10T10:29:03.445502+0000","last_undegraded":"2023-08-10T10:29:03.445502+0000","last_fullsized":"2023-08-10T10:29:03.445502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:59.873158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440834+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:04.440834+0000","last_peered":"2023-08-10T10:29:04.440834+0000","last_clean":"2023-08-10T10:29:04.440834+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:04.440834+0000","last_undegraded":"2023-08-10T10:29:04.440834+0000","last_fullsized":"2023-08-10T10:29:04.440834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796044+0000","last_change":"2023-08-10T10:29:02.508404+0000","last_active":"2023-08-10T10:29:04.796044+0000","last_peered":"2023-08-10T10:29:04.796044+0000","last_clean":"2023-08-10T10:29:04.796044+0000","last_became_active":"2023-08-10T10:29:02.508118+0000","last_became_peered":"2023-08-10T10:29:02.508118+0000","last_unstale":"2023-08-10T10:29:04.796044+0000","last_undegraded":"2023-08-10T10:29:04.796044+0000","last_fullsized":"2023-08-10T10:29:04.796044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:21.071137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796403+0000","last_change":"2023-08-10T10:29:03.449361+0000","last_active":"2023-08-10T10:29:04.796403+0000","last_peered":"2023-08-10T10:29:04.796403+0000","last_clean":"2023-08-10T10:29:04.796403+0000","last_became_active":"2023-08-10T10:29:03.448855+0000","last_became_peered":"2023-08-10T10:29:03.448855+0000","last_unstale":"2023-08-10T10:29:04.796403+0000","last_undegraded":"2023-08-10T10:29:04.796403+0000","last_fullsized":"2023-08-10T10:29:04.796403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441134+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:04.441134+0000","last_peered":"2023-08-10T10:29:04.441134+0000","last_clean":"2023-08-10T10:29:04.441134+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:04.441134+0000","last_undegraded":"2023-08-10T10:29:04.441134+0000","last_fullsized":"2023-08-10T10:29:04.441134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:24.224979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440349+0000","last_change":"2023-08-10T10:29:02.507620+0000","last_active":"2023-08-10T10:29:03.440349+0000","last_peered":"2023-08-10T10:29:03.440349+0000","last_clean":"2023-08-10T10:29:03.440349+0000","last_became_active":"2023-08-10T10:29:02.507334+0000","last_became_peered":"2023-08-10T10:29:02.507334+0000","last_unstale":"2023-08-10T10:29:03.440349+0000","last_undegraded":"2023-08-10T10:29:03.440349+0000","last_fullsized":"2023-08-10T10:29:03.440349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:13.285418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796133+0000","last_change":"2023-08-10T10:29:03.451179+0000","last_active":"2023-08-10T10:29:04.796133+0000","last_peered":"2023-08-10T10:29:04.796133+0000","last_clean":"2023-08-10T10:29:04.796133+0000","last_became_active":"2023-08-10T10:29:03.450918+0000","last_became_peered":"2023-08-10T10:29:03.450918+0000","last_unstale":"2023-08-10T10:29:04.796133+0000","last_undegraded":"2023-08-10T10:29:04.796133+0000","last_fullsized":"2023-08-10T10:29:04.796133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086651+0000","last_change":"2023-08-10T10:29:02.509567+0000","last_active":"2023-08-10T10:29:06.086651+0000","last_peered":"2023-08-10T10:29:06.086651+0000","last_clean":"2023-08-10T10:29:06.086651+0000","last_became_active":"2023-08-10T10:29:02.509227+0000","last_became_peered":"2023-08-10T10:29:02.509227+0000","last_unstale":"2023-08-10T10:29:06.086651+0000","last_undegraded":"2023-08-10T10:29:06.086651+0000","last_fullsized":"2023-08-10T10:29:06.086651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440532+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:03.440532+0000","last_peered":"2023-08-10T10:29:03.440532+0000","last_clean":"2023-08-10T10:29:03.440532+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:03.440532+0000","last_undegraded":"2023-08-10T10:29:03.440532+0000","last_fullsized":"2023-08-10T10:29:03.440532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:15.993966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.085979+0000","last_change":"2023-08-10T10:29:03.445049+0000","last_active":"2023-08-10T10:29:06.085979+0000","last_peered":"2023-08-10T10:29:06.085979+0000","last_clean":"2023-08-10T10:29:06.085979+0000","last_became_active":"2023-08-10T10:29:03.444724+0000","last_became_peered":"2023-08-10T10:29:03.444724+0000","last_unstale":"2023-08-10T10:29:06.085979+0000","last_undegraded":"2023-08-10T10:29:06.085979+0000","last_fullsized":"2023-08-10T10:29:06.085979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.437164+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:03.437164+0000","last_peered":"2023-08-10T10:29:03.437164+0000","last_clean":"2023-08-10T10:29:03.437164+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:03.437164+0000","last_undegraded":"2023-08-10T10:29:03.437164+0000","last_fullsized":"2023-08-10T10:29:03.437164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796347+0000","last_change":"2023-08-10T10:29:02.508685+0000","last_active":"2023-08-10T10:29:04.796347+0000","last_peered":"2023-08-10T10:29:04.796347+0000","last_clean":"2023-08-10T10:29:04.796347+0000","last_became_active":"2023-08-10T10:29:02.508376+0000","last_became_peered":"2023-08-10T10:29:02.508376+0000","last_unstale":"2023-08-10T10:29:04.796347+0000","last_undegraded":"2023-08-10T10:29:04.796347+0000","last_fullsized":"2023-08-10T10:29:04.796347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435479+0000","last_change":"2023-08-10T10:29:03.449122+0000","last_active":"2023-08-10T10:29:04.435479+0000","last_peered":"2023-08-10T10:29:04.435479+0000","last_clean":"2023-08-10T10:29:04.435479+0000","last_became_active":"2023-08-10T10:29:03.448040+0000","last_became_peered":"2023-08-10T10:29:03.448040+0000","last_unstale":"2023-08-10T10:29:04.435479+0000","last_undegraded":"2023-08-10T10:29:04.435479+0000","last_fullsized":"2023-08-10T10:29:04.435479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796191+0000","last_change":"2023-08-10T10:29:02.511445+0000","last_active":"2023-08-10T10:29:04.796191+0000","last_peered":"2023-08-10T10:29:04.796191+0000","last_clean":"2023-08-10T10:29:04.796191+0000","last_became_active":"2023-08-10T10:29:02.511184+0000","last_became_peered":"2023-08-10T10:29:02.511184+0000","last_unstale":"2023-08-10T10:29:04.796191+0000","last_undegraded":"2023-08-10T10:29:04.796191+0000","last_fullsized":"2023-08-10T10:29:04.796191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.500889+0000","last_change":"2023-08-10T10:29:02.506009+0000","last_active":"2023-08-10T10:29:03.500889+0000","last_peered":"2023-08-10T10:29:03.500889+0000","last_clean":"2023-08-10T10:29:03.500889+0000","last_became_active":"2023-08-10T10:29:02.505751+0000","last_became_peered":"2023-08-10T10:29:02.505751+0000","last_unstale":"2023-08-10T10:29:03.500889+0000","last_undegraded":"2023-08-10T10:29:03.500889+0000","last_fullsized":"2023-08-10T10:29:03.500889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:33.933799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436211+0000","last_change":"2023-08-10T10:29:03.440207+0000","last_active":"2023-08-10T10:29:04.436211+0000","last_peered":"2023-08-10T10:29:04.436211+0000","last_clean":"2023-08-10T10:29:04.436211+0000","last_became_active":"2023-08-10T10:29:03.439702+0000","last_became_peered":"2023-08-10T10:29:03.439702+0000","last_unstale":"2023-08-10T10:29:04.436211+0000","last_undegraded":"2023-08-10T10:29:04.436211+0000","last_fullsized":"2023-08-10T10:29:04.436211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.501395+0000","last_change":"2023-08-10T10:29:02.507533+0000","last_active":"2023-08-10T10:29:03.501395+0000","last_peered":"2023-08-10T10:29:03.501395+0000","last_clean":"2023-08-10T10:29:03.501395+0000","last_became_active":"2023-08-10T10:29:02.507215+0000","last_became_peered":"2023-08-10T10:29:02.507215+0000","last_unstale":"2023-08-10T10:29:03.501395+0000","last_undegraded":"2023-08-10T10:29:03.501395+0000","last_fullsized":"2023-08-10T10:29:03.501395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:20.179333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436223+0000","last_change":"2023-08-10T10:29:03.440169+0000","last_active":"2023-08-10T10:29:04.436223+0000","last_peered":"2023-08-10T10:29:04.436223+0000","last_clean":"2023-08-10T10:29:04.436223+0000","last_became_active":"2023-08-10T10:29:03.439746+0000","last_became_peered":"2023-08-10T10:29:03.439746+0000","last_unstale":"2023-08-10T10:29:04.436223+0000","last_undegraded":"2023-08-10T10:29:04.436223+0000","last_fullsized":"2023-08-10T10:29:04.436223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086444+0000","last_change":"2023-08-10T10:29:02.508038+0000","last_active":"2023-08-10T10:29:06.086444+0000","last_peered":"2023-08-10T10:29:06.086444+0000","last_clean":"2023-08-10T10:29:06.086444+0000","last_became_active":"2023-08-10T10:29:02.507705+0000","last_became_peered":"2023-08-10T10:29:02.507705+0000","last_unstale":"2023-08-10T10:29:06.086444+0000","last_undegraded":"2023-08-10T10:29:06.086444+0000","last_fullsized":"2023-08-10T10:29:06.086444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086412+0000","last_change":"2023-08-10T10:29:03.439576+0000","last_active":"2023-08-10T10:29:06.086412+0000","last_peered":"2023-08-10T10:29:06.086412+0000","last_clean":"2023-08-10T10:29:06.086412+0000","last_became_active":"2023-08-10T10:29:03.439303+0000","last_became_peered":"2023-08-10T10:29:03.439303+0000","last_unstale":"2023-08-10T10:29:06.086412+0000","last_undegraded":"2023-08-10T10:29:06.086412+0000","last_fullsized":"2023-08-10T10:29:06.086412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796395+0000","last_change":"2023-08-10T10:29:02.514204+0000","last_active":"2023-08-10T10:29:04.796395+0000","last_peered":"2023-08-10T10:29:04.796395+0000","last_clean":"2023-08-10T10:29:04.796395+0000","last_became_active":"2023-08-10T10:29:02.514038+0000","last_became_peered":"2023-08-10T10:29:02.514038+0000","last_unstale":"2023-08-10T10:29:04.796395+0000","last_undegraded":"2023-08-10T10:29:04.796395+0000","last_fullsized":"2023-08-10T10:29:04.796395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435320+0000","last_change":"2023-08-10T10:29:03.440843+0000","last_active":"2023-08-10T10:29:04.435320+0000","last_peered":"2023-08-10T10:29:04.435320+0000","last_clean":"2023-08-10T10:29:04.435320+0000","last_became_active":"2023-08-10T10:29:03.440587+0000","last_became_peered":"2023-08-10T10:29:03.440587+0000","last_unstale":"2023-08-10T10:29:04.435320+0000","last_undegraded":"2023-08-10T10:29:04.435320+0000","last_fullsized":"2023-08-10T10:29:04.435320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450264+0000","last_change":"2023-08-10T10:29:03.448796+0000","last_active":"2023-08-10T10:29:03.450264+0000","last_peered":"2023-08-10T10:29:03.450264+0000","last_clean":"2023-08-10T10:29:03.450264+0000","last_became_active":"2023-08-10T10:29:03.448489+0000","last_became_peered":"2023-08-10T10:29:03.448489+0000","last_unstale":"2023-08-10T10:29:03.450264+0000","last_undegraded":"2023-08-10T10:29:03.450264+0000","last_fullsized":"2023-08-10T10:29:03.450264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:46.223040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086033+0000","last_change":"2023-08-10T10:29:03.441287+0000","last_active":"2023-08-10T10:29:06.086033+0000","last_peered":"2023-08-10T10:29:06.086033+0000","last_clean":"2023-08-10T10:29:06.086033+0000","last_became_active":"2023-08-10T10:29:03.441023+0000","last_became_peered":"2023-08-10T10:29:03.441023+0000","last_unstale":"2023-08-10T10:29:06.086033+0000","last_undegraded":"2023-08-10T10:29:06.086033+0000","last_fullsized":"2023-08-10T10:29:06.086033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435948+0000","last_change":"2023-08-10T10:29:03.442345+0000","last_active":"2023-08-10T10:29:04.435948+0000","last_peered":"2023-08-10T10:29:04.435948+0000","last_clean":"2023-08-10T10:29:04.435948+0000","last_became_active":"2023-08-10T10:29:03.441657+0000","last_became_peered":"2023-08-10T10:29:03.441657+0000","last_unstale":"2023-08-10T10:29:04.435948+0000","last_undegraded":"2023-08-10T10:29:04.435948+0000","last_fullsized":"2023-08-10T10:29:04.435948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086339+0000","last_change":"2023-08-10T10:29:03.447084+0000","last_active":"2023-08-10T10:29:06.086339+0000","last_peered":"2023-08-10T10:29:06.086339+0000","last_clean":"2023-08-10T10:29:06.086339+0000","last_became_active":"2023-08-10T10:29:03.446803+0000","last_became_peered":"2023-08-10T10:29:03.446803+0000","last_unstale":"2023-08-10T10:29:06.086339+0000","last_undegraded":"2023-08-10T10:29:06.086339+0000","last_fullsized":"2023-08-10T10:29:06.086339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453612+0000","last_change":"2023-08-10T10:29:03.449287+0000","last_active":"2023-08-10T10:29:03.453612+0000","last_peered":"2023-08-10T10:29:03.453612+0000","last_clean":"2023-08-10T10:29:03.453612+0000","last_became_active":"2023-08-10T10:29:03.448995+0000","last_became_peered":"2023-08-10T10:29:03.448995+0000","last_unstale":"2023-08-10T10:29:03.453612+0000","last_undegraded":"2023-08-10T10:29:03.453612+0000","last_fullsized":"2023-08-10T10:29:03.453612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:56.439088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":87707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":88269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:08.354 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-10T10:29:08.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.506+0000 7f46a3cda700 1 Processor -- start 2023-08-10T10:29:08.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 -- start start 2023-08-10T10:29:08.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f469c06a190 0x7f469c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c071940 0x7f469c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0cf6a0 con 0x7f469c0aea70 2023-08-10T10:29:08.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c06eb80 con 0x7f469c06a190 2023-08-10T10:29:08.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a3cda700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0af510 con 0x7f469c071940 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a1a76700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f469c06a190 0x7f469c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a1a76700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f469c06a190 0x7f469c0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59904/0 (socket says 172.21.15.161:59904) 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a1275700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f469c0aea70 0x7f469c06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36910/0 (socket says 172.21.15.161:36910) 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.507+0000 7f46a1a76700 1 -- 172.21.15.161:0/4055825190 learned_addr learned my addr 172.21.15.161:0/4055825190 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a1a76700 1 -- 172.21.15.161:0/4055825190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c071940 msgr2=0x7f469c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:08.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a1a76700 1 --2- 172.21.15.161:0/4055825190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c071940 0x7f469c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a1a76700 1 -- 172.21.15.161:0/4055825190 >> v1:172.21.15.161:6789/0 conn(0x7f469c0aea70 legacy=0x7f469c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a1a76700 1 -- 172.21.15.161:0/4055825190 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c06ae60 con 0x7f469c06a190 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a0a74700 1 -- 172.21.15.161:0/4055825190 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661349745 0 0) 0x7f469c0cf6a0 con 0x7f469c0aea70 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a1a76700 1 --2- 172.21.15.161:0/4055825190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0c6810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098f0 tx=0x7f468c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0311288abfc2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a0a74700 1 -- 172.21.15.161:0/4055825190 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00b8a0 con 0x7f469c06a190 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a0a74700 1 -- 172.21.15.161:0/4055825190 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00ba00 con 0x7f469c06a190 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.508+0000 7f46a0a74700 1 -- 172.21.15.161:0/4055825190 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00bd90 con 0x7f469c06a190 2023-08-10T10:29:08.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 -- 172.21.15.161:0/4055825190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 msgr2=0x7f469c0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 --2- 172.21.15.161:0/4055825190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0c6810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098f0 tx=0x7f468c009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 -- 172.21.15.161:0/4055825190 shutdown_connections 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 --2- 172.21.15.161:0/4055825190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c071940 0x7f469c06a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 --2- 172.21.15.161:0/4055825190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0c6810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 -- 172.21.15.161:0/4055825190 >> 172.21.15.161:0/4055825190 conn(0x7f469c0cfd70 msgr2=0x7f469c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 -- 172.21.15.161:0/4055825190 shutdown_connections 2023-08-10T10:29:08.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.509+0000 7f46a3cda700 1 -- 172.21.15.161:0/4055825190 wait complete. 2023-08-10T10:29:08.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.510+0000 7f46a3cda700 1 Processor -- start 2023-08-10T10:29:08.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.510+0000 7f46a3cda700 1 -- start start 2023-08-10T10:29:08.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c071940 0x7f469c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c0aea70 0x7f469c1f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ad250 con 0x7f469c06a190 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c146c80 con 0x7f469c071940 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b58a0 con 0x7f469c0aea70 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59908/0 (socket says 172.21.15.161:59908) 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 -- 172.21.15.161:0/884418125 learned_addr learned my addr 172.21.15.161:0/884418125 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:08.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1275700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c071940 0x7f469c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a2277700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c0aea70 0x7f469c1f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 -- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c0aea70 msgr2=0x7f469c1f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c0aea70 0x7f469c1f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 -- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c071940 msgr2=0x7f469c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c071940 0x7f469c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 -- 172.21.15.161:0/884418125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009550 con 0x7f469c06a190 2023-08-10T10:29:08.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a1a76700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f468c000c00 tx=0x7f468c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0036a0 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c01e070 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0ad4a0 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c003a00 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.511+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0ada60 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.512+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0d0380 con 0x7f469c06a190 2023-08-10T10:29:08.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.513+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f468c003b60 con 0x7f469c06a190 2023-08-10T10:29:08.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.513+0000 7f46927fc700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 0x7f468006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.513+0000 7f46a1275700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 0x7f468006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.513+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f468c020070 con 0x7f469c06a190 2023-08-10T10:29:08.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.514+0000 7f46a1275700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 0x7f468006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4698000f60 tx=0x7f4698007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.518+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f468c055ad0 con 0x7f469c06a190 2023-08-10T10:29:08.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.784+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f469c0744e0 con 0x7f469c06a190 2023-08-10T10:29:08.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.784+0000 7f46927fc700 1 -- 172.21.15.161:0/884418125 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f468c0590f0 con 0x7f469c06a190 2023-08-10T10:29:08.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:08.785 INFO:teuthology.orchestra.run.smithi161.stdout:{"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1691663330,"num_in_osds":8,"osd_in_since":1691663321,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":224591872,"bytes_avail":772869521408,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4306}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-08-10T10:28:38.630697+0000","services":{}},"progress_events":{}} 2023-08-10T10:29:08.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 msgr2=0x7f468006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 0x7f468006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4698000f60 tx=0x7f4698007be0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 msgr2=0x7f469c0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f468c000c00 tx=0x7f468c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 shutdown_connections 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.786+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f468006ace0 0x7f468006d1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469c0aea70 0x7f469c1f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f469c06a190 0x7f469c0b2810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 --2- 172.21.15.161:0/884418125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c071940 0x7f469c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 >> 172.21.15.161:0/884418125 conn(0x7f469c0cfd70 msgr2=0x7f469c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:08.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 shutdown_connections 2023-08-10T10:29:08.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.787+0000 7f46a3cda700 1 -- 172.21.15.161:0/884418125 wait complete. 2023-08-10T10:29:08.799 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-10T10:29:08.799 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:08.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.919+0000 7efd6e4ac700 1 Processor -- start 2023-08-10T10:29:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.919+0000 7efd6e4ac700 1 -- start start 2023-08-10T10:29:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6e4ac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd680cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6e4ac700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd680c52c0 0x7efd680c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6e4ac700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680cc780 con 0x7efd6815b050 2023-08-10T10:29:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6e4ac700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680ccd40 con 0x7efd680c52c0 2023-08-10T10:29:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6e4ac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680ce1d0 con 0x7efd680cd7e0 2023-08-10T10:29:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd67fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efd6815b050 0x7efd680d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36922/0 (socket says 172.21.15.161:36922) 2023-08-10T10:29:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd67fff700 1 -- 172.21.15.161:0/3498548893 learned_addr learned my addr 172.21.15.161:0/3498548893 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 --2- 172.21.15.161:0/3498548893 >> v2:172.21.15.161:3300/0 conn(0x7efd680c52c0 0x7efd680c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd677fe700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd680cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd66ffd700 1 -- 172.21.15.161:0/3498548893 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546164344 0 0) 0x7efd680cc780 con 0x7efd6815b050 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd66ffd700 1 -- 172.21.15.161:0/3498548893 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd500035b0 con 0x7efd6815b050 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 -- 172.21.15.161:0/3498548893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 msgr2=0x7efd680cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd680cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 -- 172.21.15.161:0/3498548893 >> v1:172.21.15.161:6789/0 conn(0x7efd6815b050 legacy=0x7efd680d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 -- 172.21.15.161:0/3498548893 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680cca60 con 0x7efd680c52c0 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd6ca49700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd680c5710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca529702bf294e3e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.920+0000 7efd66ffd700 1 -- 172.21.15.161:0/3498548893 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000e070 con 0x7efd680c52c0 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd66ffd700 1 -- 172.21.15.161:0/3498548893 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000bb20 con 0x7efd680c52c0 2023-08-10T10:29:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd66ffd700 1 -- 172.21.15.161:0/3498548893 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60012430 con 0x7efd680c52c0 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 -- 172.21.15.161:0/3498548893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 msgr2=0x7efd680c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd680c5710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 -- 172.21.15.161:0/3498548893 shutdown_connections 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd680c5710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/3498548893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd680cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 -- 172.21.15.161:0/3498548893 >> 172.21.15.161:0/3498548893 conn(0x7efd6809a150 msgr2=0x7efd680d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 -- 172.21.15.161:0/3498548893 shutdown_connections 2023-08-10T10:29:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.921+0000 7efd6e4ac700 1 -- 172.21.15.161:0/3498548893 wait complete. 2023-08-10T10:29:08.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.922+0000 7efd6e4ac700 1 Processor -- start 2023-08-10T10:29:08.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.922+0000 7efd6e4ac700 1 -- start start 2023-08-10T10:29:08.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd681eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd6815b050 0x7efd68148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680c8a00 con 0x7efd680c52c0 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815b430 con 0x7efd6815b050 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6e4ac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815b710 con 0x7efd680cd7e0 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd67fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd67fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59922/0 (socket says 172.21.15.161:59922) 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd67fff700 1 -- 172.21.15.161:0/1047801387 learned_addr learned my addr 172.21.15.161:0/1047801387 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd6ca49700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd6815b050 0x7efd68148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.923+0000 7efd677fe700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd681eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 -- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 msgr2=0x7efd681eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd681eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 -- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd6815b050 msgr2=0x7efd68148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd6815b050 0x7efd68148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 -- 172.21.15.161:0/1047801387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009a70 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd67fff700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd5c001260 tx=0x7efd5c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0074e0 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c007640 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6815b9f0 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c005a50 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.924+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd680b4db0 con 0x7efd680c52c0 2023-08-10T10:29:08.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.925+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680744e0 con 0x7efd680c52c0 2023-08-10T10:29:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.925+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd5c005bb0 con 0x7efd680c52c0 2023-08-10T10:29:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.926+0000 7efd64ff9700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 0x7efd5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.926+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd5c0888c0 con 0x7efd680c52c0 2023-08-10T10:29:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.926+0000 7efd677fe700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 0x7efd5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.926+0000 7efd677fe700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 0x7efd5406d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd680d0f10 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:08.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:08.930+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd5c057400 con 0x7efd680c52c0 2023-08-10T10:29:09.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.114+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd6815b5a0 con 0x7efd5406ace0 2023-08-10T10:29:09.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.121+0000 7efd64ff9700 1 -- 172.21.15.161:0/1047801387 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286797 (secure 0 0 0) 0x7efd6815b5a0 con 0x7efd5406ace0 2023-08-10T10:29:09.193 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:09.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 msgr2=0x7efd5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 0x7efd5406d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd680d0f10 tx=0x7efd58008040 comp rx=0 tx=0).stop 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 msgr2=0x7efd68146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd5c001260 tx=0x7efd5c00c9e0 comp rx=0 tx=0).stop 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 shutdown_connections 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7efd5406ace0 0x7efd5406d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd6815b050 0x7efd68148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:09.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd680c52c0 0x7efd68146d50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:09.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 --2- 172.21.15.161:0/1047801387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd680cd7e0 0x7efd681eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:09.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.124+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 >> 172.21.15.161:0/1047801387 conn(0x7efd6809a150 msgr2=0x7efd680c56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:09.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.125+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 shutdown_connections 2023-08-10T10:29:09.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:09.125+0000 7efd6e4ac700 1 -- 172.21.15.161:0/1047801387 wait complete. 2023-08-10T10:29:09.196 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:09.197 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-10T10:29:08.187714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219328,"kb_used_data":3148,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755392,"statfs":{"total":773094113280,"available":772869521408,"internally_reserved":0,"allocated":3223552,"data_stored":1906355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001229"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452374+0000","last_change":"2023-08-10T10:29:03.450108+0000","last_active":"2023-08-10T10:29:03.452374+0000","last_peered":"2023-08-10T10:29:03.452374+0000","last_clean":"2023-08-10T10:29:03.452374+0000","last_became_active":"2023-08-10T10:29:03.449434+0000","last_became_peered":"2023-08-10T10:29:03.449434+0000","last_unstale":"2023-08-10T10:29:03.452374+0000","last_undegraded":"2023-08-10T10:29:03.452374+0000","last_fullsized":"2023-08-10T10:29:03.452374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:46.112179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435719+0000","last_change":"2023-08-10T10:29:03.449144+0000","last_active":"2023-08-10T10:29:04.435719+0000","last_peered":"2023-08-10T10:29:04.435719+0000","last_clean":"2023-08-10T10:29:04.435719+0000","last_became_active":"2023-08-10T10:29:03.448690+0000","last_became_peered":"2023-08-10T10:29:03.448690+0000","last_unstale":"2023-08-10T10:29:04.435719+0000","last_undegraded":"2023-08-10T10:29:04.435719+0000","last_fullsized":"2023-08-10T10:29:04.435719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450284+0000","last_change":"2023-08-10T10:29:03.448973+0000","last_active":"2023-08-10T10:29:03.450284+0000","last_peered":"2023-08-10T10:29:03.450284+0000","last_clean":"2023-08-10T10:29:03.450284+0000","last_became_active":"2023-08-10T10:29:03.448666+0000","last_became_peered":"2023-08-10T10:29:03.448666+0000","last_unstale":"2023-08-10T10:29:03.450284+0000","last_undegraded":"2023-08-10T10:29:03.450284+0000","last_fullsized":"2023-08-10T10:29:03.450284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:01:44.195849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.795980+0000","last_change":"2023-08-10T10:29:03.451710+0000","last_active":"2023-08-10T10:29:04.795980+0000","last_peered":"2023-08-10T10:29:04.795980+0000","last_clean":"2023-08-10T10:29:04.795980+0000","last_became_active":"2023-08-10T10:29:03.451411+0000","last_became_peered":"2023-08-10T10:29:03.451411+0000","last_unstale":"2023-08-10T10:29:04.795980+0000","last_undegraded":"2023-08-10T10:29:04.795980+0000","last_fullsized":"2023-08-10T10:29:04.795980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435794+0000","last_change":"2023-08-10T10:29:03.451672+0000","last_active":"2023-08-10T10:29:04.435794+0000","last_peered":"2023-08-10T10:29:04.435794+0000","last_clean":"2023-08-10T10:29:04.435794+0000","last_became_active":"2023-08-10T10:29:03.451376+0000","last_became_peered":"2023-08-10T10:29:03.451376+0000","last_unstale":"2023-08-10T10:29:04.435794+0000","last_undegraded":"2023-08-10T10:29:04.435794+0000","last_fullsized":"2023-08-10T10:29:04.435794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440823+0000","last_change":"2023-08-10T10:29:03.444231+0000","last_active":"2023-08-10T10:29:04.440823+0000","last_peered":"2023-08-10T10:29:04.440823+0000","last_clean":"2023-08-10T10:29:04.440823+0000","last_became_active":"2023-08-10T10:29:03.443264+0000","last_became_peered":"2023-08-10T10:29:03.443264+0000","last_unstale":"2023-08-10T10:29:04.440823+0000","last_undegraded":"2023-08-10T10:29:04.440823+0000","last_fullsized":"2023-08-10T10:29:04.440823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.451713+0000","last_change":"2023-08-10T10:29:03.447620+0000","last_active":"2023-08-10T10:29:03.451713+0000","last_peered":"2023-08-10T10:29:03.451713+0000","last_clean":"2023-08-10T10:29:03.451713+0000","last_became_active":"2023-08-10T10:29:03.447339+0000","last_became_peered":"2023-08-10T10:29:03.447339+0000","last_unstale":"2023-08-10T10:29:03.451713+0000","last_undegraded":"2023-08-10T10:29:03.451713+0000","last_fullsized":"2023-08-10T10:29:03.451713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796204+0000","last_change":"2023-08-10T10:29:03.450118+0000","last_active":"2023-08-10T10:29:04.796204+0000","last_peered":"2023-08-10T10:29:04.796204+0000","last_clean":"2023-08-10T10:29:04.796204+0000","last_became_active":"2023-08-10T10:29:03.449864+0000","last_became_peered":"2023-08-10T10:29:03.449864+0000","last_unstale":"2023-08-10T10:29:04.796204+0000","last_undegraded":"2023-08-10T10:29:04.796204+0000","last_fullsized":"2023-08-10T10:29:04.796204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452711+0000","last_change":"2023-08-10T10:29:03.451715+0000","last_active":"2023-08-10T10:29:03.452711+0000","last_peered":"2023-08-10T10:29:03.452711+0000","last_clean":"2023-08-10T10:29:03.452711+0000","last_became_active":"2023-08-10T10:29:03.451414+0000","last_became_peered":"2023-08-10T10:29:03.451414+0000","last_unstale":"2023-08-10T10:29:03.452711+0000","last_undegraded":"2023-08-10T10:29:03.452711+0000","last_fullsized":"2023-08-10T10:29:03.452711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:14.287109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435674+0000","last_change":"2023-08-10T10:29:03.443457+0000","last_active":"2023-08-10T10:29:04.435674+0000","last_peered":"2023-08-10T10:29:04.435674+0000","last_clean":"2023-08-10T10:29:04.435674+0000","last_became_active":"2023-08-10T10:29:03.443182+0000","last_became_peered":"2023-08-10T10:29:03.443182+0000","last_unstale":"2023-08-10T10:29:04.435674+0000","last_undegraded":"2023-08-10T10:29:04.435674+0000","last_fullsized":"2023-08-10T10:29:04.435674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452220+0000","last_change":"2023-08-10T10:29:03.448673+0000","last_active":"2023-08-10T10:29:03.452220+0000","last_peered":"2023-08-10T10:29:03.452220+0000","last_clean":"2023-08-10T10:29:03.452220+0000","last_became_active":"2023-08-10T10:29:03.448378+0000","last_became_peered":"2023-08-10T10:29:03.448378+0000","last_unstale":"2023-08-10T10:29:03.452220+0000","last_undegraded":"2023-08-10T10:29:03.452220+0000","last_fullsized":"2023-08-10T10:29:03.452220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441146+0000","last_change":"2023-08-10T10:29:03.445496+0000","last_active":"2023-08-10T10:29:04.441146+0000","last_peered":"2023-08-10T10:29:04.441146+0000","last_clean":"2023-08-10T10:29:04.441146+0000","last_became_active":"2023-08-10T10:29:03.445239+0000","last_became_peered":"2023-08-10T10:29:03.445239+0000","last_unstale":"2023-08-10T10:29:04.441146+0000","last_undegraded":"2023-08-10T10:29:04.441146+0000","last_fullsized":"2023-08-10T10:29:04.441146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:50.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.451219+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.450957+0000","last_became_peered":"2023-08-10T10:29:03.450957+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:22.072828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796266+0000","last_change":"2023-08-10T10:29:03.450677+0000","last_active":"2023-08-10T10:29:04.796266+0000","last_peered":"2023-08-10T10:29:04.796266+0000","last_clean":"2023-08-10T10:29:04.796266+0000","last_became_active":"2023-08-10T10:29:03.450414+0000","last_became_peered":"2023-08-10T10:29:03.450414+0000","last_unstale":"2023-08-10T10:29:04.796266+0000","last_undegraded":"2023-08-10T10:29:04.796266+0000","last_fullsized":"2023-08-10T10:29:04.796266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435726+0000","last_change":"2023-08-10T10:29:03.448733+0000","last_active":"2023-08-10T10:29:04.435726+0000","last_peered":"2023-08-10T10:29:04.435726+0000","last_clean":"2023-08-10T10:29:04.435726+0000","last_became_active":"2023-08-10T10:29:03.448379+0000","last_became_peered":"2023-08-10T10:29:03.448379+0000","last_unstale":"2023-08-10T10:29:04.435726+0000","last_undegraded":"2023-08-10T10:29:04.435726+0000","last_fullsized":"2023-08-10T10:29:04.435726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435953+0000","last_change":"2023-08-10T10:29:03.442226+0000","last_active":"2023-08-10T10:29:04.435953+0000","last_peered":"2023-08-10T10:29:04.435953+0000","last_clean":"2023-08-10T10:29:04.435953+0000","last_became_active":"2023-08-10T10:29:03.441986+0000","last_became_peered":"2023-08-10T10:29:03.441986+0000","last_unstale":"2023-08-10T10:29:04.435953+0000","last_undegraded":"2023-08-10T10:29:04.435953+0000","last_fullsized":"2023-08-10T10:29:04.435953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441131+0000","last_change":"2023-08-10T10:29:03.447854+0000","last_active":"2023-08-10T10:29:04.441131+0000","last_peered":"2023-08-10T10:29:04.441131+0000","last_clean":"2023-08-10T10:29:04.441131+0000","last_became_active":"2023-08-10T10:29:03.447513+0000","last_became_peered":"2023-08-10T10:29:03.447513+0000","last_unstale":"2023-08-10T10:29:04.441131+0000","last_undegraded":"2023-08-10T10:29:04.441131+0000","last_fullsized":"2023-08-10T10:29:04.441131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796072+0000","last_change":"2023-08-10T10:29:03.450633+0000","last_active":"2023-08-10T10:29:04.796072+0000","last_peered":"2023-08-10T10:29:04.796072+0000","last_clean":"2023-08-10T10:29:04.796072+0000","last_became_active":"2023-08-10T10:29:03.450345+0000","last_became_peered":"2023-08-10T10:29:03.450345+0000","last_unstale":"2023-08-10T10:29:04.796072+0000","last_undegraded":"2023-08-10T10:29:04.796072+0000","last_fullsized":"2023-08-10T10:29:04.796072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086320+0000","last_change":"2023-08-10T10:29:03.451595+0000","last_active":"2023-08-10T10:29:06.086320+0000","last_peered":"2023-08-10T10:29:06.086320+0000","last_clean":"2023-08-10T10:29:06.086320+0000","last_became_active":"2023-08-10T10:29:03.451277+0000","last_became_peered":"2023-08-10T10:29:03.451277+0000","last_unstale":"2023-08-10T10:29:06.086320+0000","last_undegraded":"2023-08-10T10:29:06.086320+0000","last_fullsized":"2023-08-10T10:29:06.086320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440927+0000","last_change":"2023-08-10T10:29:03.448073+0000","last_active":"2023-08-10T10:29:04.440927+0000","last_peered":"2023-08-10T10:29:04.440927+0000","last_clean":"2023-08-10T10:29:04.440927+0000","last_became_active":"2023-08-10T10:29:03.447608+0000","last_became_peered":"2023-08-10T10:29:03.447608+0000","last_unstale":"2023-08-10T10:29:04.440927+0000","last_undegraded":"2023-08-10T10:29:04.440927+0000","last_fullsized":"2023-08-10T10:29:04.440927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.448239+0000","last_change":"2023-08-10T10:29:03.444304+0000","last_active":"2023-08-10T10:29:03.448239+0000","last_peered":"2023-08-10T10:29:03.448239+0000","last_clean":"2023-08-10T10:29:03.448239+0000","last_became_active":"2023-08-10T10:29:03.441797+0000","last_became_peered":"2023-08-10T10:29:03.441797+0000","last_unstale":"2023-08-10T10:29:03.448239+0000","last_undegraded":"2023-08-10T10:29:03.448239+0000","last_fullsized":"2023-08-10T10:29:03.448239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453594+0000","last_change":"2023-08-10T10:29:03.448858+0000","last_active":"2023-08-10T10:29:03.453594+0000","last_peered":"2023-08-10T10:29:03.453594+0000","last_clean":"2023-08-10T10:29:03.453594+0000","last_became_active":"2023-08-10T10:29:03.448575+0000","last_became_peered":"2023-08-10T10:29:03.448575+0000","last_unstale":"2023-08-10T10:29:03.453594+0000","last_undegraded":"2023-08-10T10:29:03.453594+0000","last_fullsized":"2023-08-10T10:29:03.453594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:46.112179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452325+0000","last_change":"2023-08-10T10:29:03.449820+0000","last_active":"2023-08-10T10:29:03.452325+0000","last_peered":"2023-08-10T10:29:03.452325+0000","last_clean":"2023-08-10T10:29:03.452325+0000","last_became_active":"2023-08-10T10:29:03.449280+0000","last_became_peered":"2023-08-10T10:29:03.449280+0000","last_unstale":"2023-08-10T10:29:03.452325+0000","last_undegraded":"2023-08-10T10:29:03.452325+0000","last_fullsized":"2023-08-10T10:29:03.452325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:43.080354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436273+0000","last_change":"2023-08-10T10:29:02.509556+0000","last_active":"2023-08-10T10:29:04.436273+0000","last_peered":"2023-08-10T10:29:04.436273+0000","last_clean":"2023-08-10T10:29:04.436273+0000","last_became_active":"2023-08-10T10:29:02.509283+0000","last_became_peered":"2023-08-10T10:29:02.509283+0000","last_unstale":"2023-08-10T10:29:04.436273+0000","last_undegraded":"2023-08-10T10:29:04.436273+0000","last_fullsized":"2023-08-10T10:29:04.436273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086441+0000","last_change":"2023-08-10T10:29:03.443570+0000","last_active":"2023-08-10T10:29:06.086441+0000","last_peered":"2023-08-10T10:29:06.086441+0000","last_clean":"2023-08-10T10:29:06.086441+0000","last_became_active":"2023-08-10T10:29:03.443302+0000","last_became_peered":"2023-08-10T10:29:03.443302+0000","last_unstale":"2023-08-10T10:29:06.086441+0000","last_undegraded":"2023-08-10T10:29:06.086441+0000","last_fullsized":"2023-08-10T10:29:06.086441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440254+0000","last_change":"2023-08-10T10:29:02.510076+0000","last_active":"2023-08-10T10:29:03.440254+0000","last_peered":"2023-08-10T10:29:03.440254+0000","last_clean":"2023-08-10T10:29:03.440254+0000","last_became_active":"2023-08-10T10:29:02.509806+0000","last_became_peered":"2023-08-10T10:29:02.509806+0000","last_unstale":"2023-08-10T10:29:03.440254+0000","last_undegraded":"2023-08-10T10:29:03.440254+0000","last_fullsized":"2023-08-10T10:29:03.440254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:37.593152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796264+0000","last_change":"2023-08-10T10:29:03.450711+0000","last_active":"2023-08-10T10:29:04.796264+0000","last_peered":"2023-08-10T10:29:04.796264+0000","last_clean":"2023-08-10T10:29:04.796264+0000","last_became_active":"2023-08-10T10:29:03.450363+0000","last_became_peered":"2023-08-10T10:29:03.450363+0000","last_unstale":"2023-08-10T10:29:04.796264+0000","last_undegraded":"2023-08-10T10:29:04.796264+0000","last_fullsized":"2023-08-10T10:29:04.796264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086179+0000","last_change":"2023-08-10T10:29:02.509352+0000","last_active":"2023-08-10T10:29:06.086179+0000","last_peered":"2023-08-10T10:29:06.086179+0000","last_clean":"2023-08-10T10:29:06.086179+0000","last_became_active":"2023-08-10T10:29:02.509050+0000","last_became_peered":"2023-08-10T10:29:02.509050+0000","last_unstale":"2023-08-10T10:29:06.086179+0000","last_undegraded":"2023-08-10T10:29:06.086179+0000","last_fullsized":"2023-08-10T10:29:06.086179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:03.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450859+0000","last_change":"2023-08-10T10:29:03.449521+0000","last_active":"2023-08-10T10:29:03.450859+0000","last_peered":"2023-08-10T10:29:03.450859+0000","last_clean":"2023-08-10T10:29:03.450859+0000","last_became_active":"2023-08-10T10:29:03.449254+0000","last_became_peered":"2023-08-10T10:29:03.449254+0000","last_unstale":"2023-08-10T10:29:03.450859+0000","last_undegraded":"2023-08-10T10:29:03.450859+0000","last_fullsized":"2023-08-10T10:29:03.450859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:40.447090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796291+0000","last_change":"2023-08-10T10:29:02.514169+0000","last_active":"2023-08-10T10:29:04.796291+0000","last_peered":"2023-08-10T10:29:04.796291+0000","last_clean":"2023-08-10T10:29:04.796291+0000","last_became_active":"2023-08-10T10:29:02.513967+0000","last_became_peered":"2023-08-10T10:29:02.513967+0000","last_unstale":"2023-08-10T10:29:04.796291+0000","last_undegraded":"2023-08-10T10:29:04.796291+0000","last_fullsized":"2023-08-10T10:29:04.796291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086126+0000","last_change":"2023-08-10T10:29:03.440626+0000","last_active":"2023-08-10T10:29:06.086126+0000","last_peered":"2023-08-10T10:29:06.086126+0000","last_clean":"2023-08-10T10:29:06.086126+0000","last_became_active":"2023-08-10T10:29:03.440266+0000","last_became_peered":"2023-08-10T10:29:03.440266+0000","last_unstale":"2023-08-10T10:29:06.086126+0000","last_undegraded":"2023-08-10T10:29:06.086126+0000","last_fullsized":"2023-08-10T10:29:06.086126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.445499+0000","last_change":"2023-08-10T10:29:02.505024+0000","last_active":"2023-08-10T10:29:03.445499+0000","last_peered":"2023-08-10T10:29:03.445499+0000","last_clean":"2023-08-10T10:29:03.445499+0000","last_became_active":"2023-08-10T10:29:02.504178+0000","last_became_peered":"2023-08-10T10:29:02.504178+0000","last_unstale":"2023-08-10T10:29:03.445499+0000","last_undegraded":"2023-08-10T10:29:03.445499+0000","last_fullsized":"2023-08-10T10:29:03.445499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:37.593152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086183+0000","last_change":"2023-08-10T10:29:03.444252+0000","last_active":"2023-08-10T10:29:06.086183+0000","last_peered":"2023-08-10T10:29:06.086183+0000","last_clean":"2023-08-10T10:29:06.086183+0000","last_became_active":"2023-08-10T10:29:03.443982+0000","last_became_peered":"2023-08-10T10:29:03.443982+0000","last_unstale":"2023-08-10T10:29:06.086183+0000","last_undegraded":"2023-08-10T10:29:06.086183+0000","last_fullsized":"2023-08-10T10:29:06.086183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441209+0000","last_change":"2023-08-10T10:29:02.510256+0000","last_active":"2023-08-10T10:29:04.441209+0000","last_peered":"2023-08-10T10:29:04.441209+0000","last_clean":"2023-08-10T10:29:04.441209+0000","last_became_active":"2023-08-10T10:29:02.510054+0000","last_became_peered":"2023-08-10T10:29:02.510054+0000","last_unstale":"2023-08-10T10:29:04.441209+0000","last_undegraded":"2023-08-10T10:29:04.441209+0000","last_fullsized":"2023-08-10T10:29:04.441209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:03.509285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.448669+0000","last_change":"2023-08-10T10:29:03.442886+0000","last_active":"2023-08-10T10:29:03.448669+0000","last_peered":"2023-08-10T10:29:03.448669+0000","last_clean":"2023-08-10T10:29:03.448669+0000","last_became_active":"2023-08-10T10:29:03.442103+0000","last_became_peered":"2023-08-10T10:29:03.442103+0000","last_unstale":"2023-08-10T10:29:03.448669+0000","last_undegraded":"2023-08-10T10:29:03.448669+0000","last_fullsized":"2023-08-10T10:29:03.448669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436220+0000","last_change":"2023-08-10T10:29:02.504354+0000","last_active":"2023-08-10T10:29:04.436220+0000","last_peered":"2023-08-10T10:29:04.436220+0000","last_clean":"2023-08-10T10:29:04.436220+0000","last_became_active":"2023-08-10T10:29:02.503879+0000","last_became_peered":"2023-08-10T10:29:02.503879+0000","last_unstale":"2023-08-10T10:29:04.436220+0000","last_undegraded":"2023-08-10T10:29:04.436220+0000","last_fullsized":"2023-08-10T10:29:04.436220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436378+0000","last_change":"2023-08-10T10:29:03.440803+0000","last_active":"2023-08-10T10:29:04.436378+0000","last_peered":"2023-08-10T10:29:04.436378+0000","last_clean":"2023-08-10T10:29:04.436378+0000","last_became_active":"2023-08-10T10:29:03.440491+0000","last_became_peered":"2023-08-10T10:29:03.440491+0000","last_unstale":"2023-08-10T10:29:04.436378+0000","last_undegraded":"2023-08-10T10:29:04.436378+0000","last_fullsized":"2023-08-10T10:29:04.436378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:04.510976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441036+0000","last_change":"2023-08-10T10:29:02.506354+0000","last_active":"2023-08-10T10:29:04.441036+0000","last_peered":"2023-08-10T10:29:04.441036+0000","last_clean":"2023-08-10T10:29:04.441036+0000","last_became_active":"2023-08-10T10:29:02.506110+0000","last_became_peered":"2023-08-10T10:29:02.506110+0000","last_unstale":"2023-08-10T10:29:04.441036+0000","last_undegraded":"2023-08-10T10:29:04.441036+0000","last_fullsized":"2023-08-10T10:29:04.441036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.953593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086288+0000","last_change":"2023-08-10T10:29:03.443853+0000","last_active":"2023-08-10T10:29:06.086288+0000","last_peered":"2023-08-10T10:29:06.086288+0000","last_clean":"2023-08-10T10:29:06.086288+0000","last_became_active":"2023-08-10T10:29:03.443591+0000","last_became_peered":"2023-08-10T10:29:03.443591+0000","last_unstale":"2023-08-10T10:29:06.086288+0000","last_undegraded":"2023-08-10T10:29:06.086288+0000","last_fullsized":"2023-08-10T10:29:06.086288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796014+0000","last_change":"2023-08-10T10:29:02.508938+0000","last_active":"2023-08-10T10:29:04.796014+0000","last_peered":"2023-08-10T10:29:04.796014+0000","last_clean":"2023-08-10T10:29:04.796014+0000","last_became_active":"2023-08-10T10:29:02.508669+0000","last_became_peered":"2023-08-10T10:29:02.508669+0000","last_unstale":"2023-08-10T10:29:04.796014+0000","last_undegraded":"2023-08-10T10:29:04.796014+0000","last_fullsized":"2023-08-10T10:29:04.796014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452381+0000","last_change":"2023-08-10T10:29:03.450335+0000","last_active":"2023-08-10T10:29:03.452381+0000","last_peered":"2023-08-10T10:29:03.452381+0000","last_clean":"2023-08-10T10:29:03.452381+0000","last_became_active":"2023-08-10T10:29:03.449118+0000","last_became_peered":"2023-08-10T10:29:03.449118+0000","last_unstale":"2023-08-10T10:29:03.452381+0000","last_undegraded":"2023-08-10T10:29:03.452381+0000","last_fullsized":"2023-08-10T10:29:03.452381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:59.873158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440904+0000","last_change":"2023-08-10T10:29:02.508190+0000","last_active":"2023-08-10T10:29:04.440904+0000","last_peered":"2023-08-10T10:29:04.440904+0000","last_clean":"2023-08-10T10:29:04.440904+0000","last_became_active":"2023-08-10T10:29:02.507882+0000","last_became_peered":"2023-08-10T10:29:02.507882+0000","last_unstale":"2023-08-10T10:29:04.440904+0000","last_undegraded":"2023-08-10T10:29:04.440904+0000","last_fullsized":"2023-08-10T10:29:04.440904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796210+0000","last_change":"2023-08-10T10:29:03.448316+0000","last_active":"2023-08-10T10:29:04.796210+0000","last_peered":"2023-08-10T10:29:04.796210+0000","last_clean":"2023-08-10T10:29:04.796210+0000","last_became_active":"2023-08-10T10:29:03.447711+0000","last_became_peered":"2023-08-10T10:29:03.447711+0000","last_unstale":"2023-08-10T10:29:04.796210+0000","last_undegraded":"2023-08-10T10:29:04.796210+0000","last_fullsized":"2023-08-10T10:29:04.796210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.500514+0000","last_change":"2023-08-10T10:29:02.508683+0000","last_active":"2023-08-10T10:29:03.500514+0000","last_peered":"2023-08-10T10:29:03.500514+0000","last_clean":"2023-08-10T10:29:03.500514+0000","last_became_active":"2023-08-10T10:29:02.508399+0000","last_became_peered":"2023-08-10T10:29:02.508399+0000","last_unstale":"2023-08-10T10:29:03.500514+0000","last_undegraded":"2023-08-10T10:29:03.500514+0000","last_fullsized":"2023-08-10T10:29:03.500514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:02.781878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086773+0000","last_change":"2023-08-10T10:29:03.444878+0000","last_active":"2023-08-10T10:29:06.086773+0000","last_peered":"2023-08-10T10:29:06.086773+0000","last_clean":"2023-08-10T10:29:06.086773+0000","last_became_active":"2023-08-10T10:29:03.444560+0000","last_became_peered":"2023-08-10T10:29:03.444560+0000","last_unstale":"2023-08-10T10:29:06.086773+0000","last_undegraded":"2023-08-10T10:29:06.086773+0000","last_fullsized":"2023-08-10T10:29:06.086773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441325+0000","last_change":"2023-08-10T10:29:02.506132+0000","last_active":"2023-08-10T10:29:04.441325+0000","last_peered":"2023-08-10T10:29:04.441325+0000","last_clean":"2023-08-10T10:29:04.441325+0000","last_became_active":"2023-08-10T10:29:02.505862+0000","last_became_peered":"2023-08-10T10:29:02.505862+0000","last_unstale":"2023-08-10T10:29:04.441325+0000","last_undegraded":"2023-08-10T10:29:04.441325+0000","last_fullsized":"2023-08-10T10:29:04.441325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:53.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.452252+0000","last_change":"2023-08-10T10:29:03.448717+0000","last_active":"2023-08-10T10:29:03.452252+0000","last_peered":"2023-08-10T10:29:03.452252+0000","last_clean":"2023-08-10T10:29:03.452252+0000","last_became_active":"2023-08-10T10:29:03.448231+0000","last_became_peered":"2023-08-10T10:29:03.448231+0000","last_unstale":"2023-08-10T10:29:03.452252+0000","last_undegraded":"2023-08-10T10:29:03.452252+0000","last_fullsized":"2023-08-10T10:29:03.452252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441232+0000","last_change":"2023-08-10T10:29:02.503467+0000","last_active":"2023-08-10T10:29:04.441232+0000","last_peered":"2023-08-10T10:29:04.441232+0000","last_clean":"2023-08-10T10:29:04.441232+0000","last_became_active":"2023-08-10T10:29:02.503095+0000","last_became_peered":"2023-08-10T10:29:02.503095+0000","last_unstale":"2023-08-10T10:29:04.441232+0000","last_undegraded":"2023-08-10T10:29:04.441232+0000","last_fullsized":"2023-08-10T10:29:04.441232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:52.156146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.443580+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.443304+0000","last_became_peered":"2023-08-10T10:29:03.443304+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441314+0000","last_change":"2023-08-10T10:29:02.508008+0000","last_active":"2023-08-10T10:29:04.441314+0000","last_peered":"2023-08-10T10:29:04.441314+0000","last_clean":"2023-08-10T10:29:04.441314+0000","last_became_active":"2023-08-10T10:29:02.507657+0000","last_became_peered":"2023-08-10T10:29:02.507657+0000","last_unstale":"2023-08-10T10:29:04.441314+0000","last_undegraded":"2023-08-10T10:29:04.441314+0000","last_fullsized":"2023-08-10T10:29:04.441314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:55.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.443016+0000","last_change":"2023-08-10T10:29:03.440621+0000","last_active":"2023-08-10T10:29:03.443016+0000","last_peered":"2023-08-10T10:29:03.443016+0000","last_clean":"2023-08-10T10:29:03.443016+0000","last_became_active":"2023-08-10T10:29:03.440332+0000","last_became_peered":"2023-08-10T10:29:03.440332+0000","last_unstale":"2023-08-10T10:29:03.443016+0000","last_undegraded":"2023-08-10T10:29:03.443016+0000","last_fullsized":"2023-08-10T10:29:03.443016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:23.255768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.444703+0000","last_change":"2023-08-10T10:29:02.509818+0000","last_active":"2023-08-10T10:29:03.444703+0000","last_peered":"2023-08-10T10:29:03.444703+0000","last_clean":"2023-08-10T10:29:03.444703+0000","last_became_active":"2023-08-10T10:29:02.509518+0000","last_became_peered":"2023-08-10T10:29:02.509518+0000","last_unstale":"2023-08-10T10:29:03.444703+0000","last_undegraded":"2023-08-10T10:29:03.444703+0000","last_fullsized":"2023-08-10T10:29:03.444703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:55.437397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796348+0000","last_change":"2023-08-10T10:29:03.447884+0000","last_active":"2023-08-10T10:29:04.796348+0000","last_peered":"2023-08-10T10:29:04.796348+0000","last_clean":"2023-08-10T10:29:04.796348+0000","last_became_active":"2023-08-10T10:29:03.447609+0000","last_became_peered":"2023-08-10T10:29:03.447609+0000","last_unstale":"2023-08-10T10:29:04.796348+0000","last_undegraded":"2023-08-10T10:29:04.796348+0000","last_fullsized":"2023-08-10T10:29:04.796348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086361+0000","last_change":"2023-08-10T10:29:02.508827+0000","last_active":"2023-08-10T10:29:06.086361+0000","last_peered":"2023-08-10T10:29:06.086361+0000","last_clean":"2023-08-10T10:29:06.086361+0000","last_became_active":"2023-08-10T10:29:02.508532+0000","last_became_peered":"2023-08-10T10:29:02.508532+0000","last_unstale":"2023-08-10T10:29:06.086361+0000","last_undegraded":"2023-08-10T10:29:06.086361+0000","last_fullsized":"2023-08-10T10:29:06.086361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436080+0000","last_change":"2023-08-10T10:29:03.442543+0000","last_active":"2023-08-10T10:29:04.436080+0000","last_peered":"2023-08-10T10:29:04.436080+0000","last_clean":"2023-08-10T10:29:04.436080+0000","last_became_active":"2023-08-10T10:29:03.439760+0000","last_became_peered":"2023-08-10T10:29:03.439760+0000","last_unstale":"2023-08-10T10:29:04.436080+0000","last_undegraded":"2023-08-10T10:29:04.436080+0000","last_fullsized":"2023-08-10T10:29:04.436080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.436353+0000","last_change":"2023-08-10T10:29:02.511617+0000","last_active":"2023-08-10T10:29:03.436353+0000","last_peered":"2023-08-10T10:29:03.436353+0000","last_clean":"2023-08-10T10:29:03.436353+0000","last_became_active":"2023-08-10T10:29:02.511332+0000","last_became_peered":"2023-08-10T10:29:02.511332+0000","last_unstale":"2023-08-10T10:29:03.436353+0000","last_undegraded":"2023-08-10T10:29:03.436353+0000","last_fullsized":"2023-08-10T10:29:03.436353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:54.612454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435889+0000","last_change":"2023-08-10T10:29:03.438600+0000","last_active":"2023-08-10T10:29:04.435889+0000","last_peered":"2023-08-10T10:29:04.435889+0000","last_clean":"2023-08-10T10:29:04.435889+0000","last_became_active":"2023-08-10T10:29:03.438329+0000","last_became_peered":"2023-08-10T10:29:03.438329+0000","last_unstale":"2023-08-10T10:29:04.435889+0000","last_undegraded":"2023-08-10T10:29:04.435889+0000","last_fullsized":"2023-08-10T10:29:04.435889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435725+0000","last_change":"2023-08-10T10:29:02.501143+0000","last_active":"2023-08-10T10:29:04.435725+0000","last_peered":"2023-08-10T10:29:04.435725+0000","last_clean":"2023-08-10T10:29:04.435725+0000","last_became_active":"2023-08-10T10:29:02.500734+0000","last_became_peered":"2023-08-10T10:29:02.500734+0000","last_unstale":"2023-08-10T10:29:04.435725+0000","last_undegraded":"2023-08-10T10:29:04.435725+0000","last_fullsized":"2023-08-10T10:29:04.435725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435945+0000","last_change":"2023-08-10T10:29:03.441585+0000","last_active":"2023-08-10T10:29:04.435945+0000","last_peered":"2023-08-10T10:29:04.435945+0000","last_clean":"2023-08-10T10:29:04.435945+0000","last_became_active":"2023-08-10T10:29:03.441315+0000","last_became_peered":"2023-08-10T10:29:03.441315+0000","last_unstale":"2023-08-10T10:29:04.435945+0000","last_undegraded":"2023-08-10T10:29:04.435945+0000","last_fullsized":"2023-08-10T10:29:04.435945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086015+0000","last_change":"2023-08-10T10:29:02.509843+0000","last_active":"2023-08-10T10:29:06.086015+0000","last_peered":"2023-08-10T10:29:06.086015+0000","last_clean":"2023-08-10T10:29:06.086015+0000","last_became_active":"2023-08-10T10:29:02.509581+0000","last_became_peered":"2023-08-10T10:29:02.509581+0000","last_unstale":"2023-08-10T10:29:06.086015+0000","last_undegraded":"2023-08-10T10:29:06.086015+0000","last_fullsized":"2023-08-10T10:29:06.086015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453531+0000","last_change":"2023-08-10T10:29:03.447663+0000","last_active":"2023-08-10T10:29:03.453531+0000","last_peered":"2023-08-10T10:29:03.453531+0000","last_clean":"2023-08-10T10:29:03.453531+0000","last_became_active":"2023-08-10T10:29:03.447249+0000","last_became_peered":"2023-08-10T10:29:03.447249+0000","last_unstale":"2023-08-10T10:29:03.453531+0000","last_undegraded":"2023-08-10T10:29:03.453531+0000","last_fullsized":"2023-08-10T10:29:03.453531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:33.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440129+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:03.440129+0000","last_peered":"2023-08-10T10:29:03.440129+0000","last_clean":"2023-08-10T10:29:03.440129+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:03.440129+0000","last_undegraded":"2023-08-10T10:29:03.440129+0000","last_fullsized":"2023-08-10T10:29:03.440129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:37.893295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.446160+0000","last_change":"2023-08-10T10:29:02.509950+0000","last_active":"2023-08-10T10:29:03.446160+0000","last_peered":"2023-08-10T10:29:03.446160+0000","last_clean":"2023-08-10T10:29:03.446160+0000","last_became_active":"2023-08-10T10:29:02.509612+0000","last_became_peered":"2023-08-10T10:29:02.509612+0000","last_unstale":"2023-08-10T10:29:03.446160+0000","last_undegraded":"2023-08-10T10:29:03.446160+0000","last_fullsized":"2023-08-10T10:29:03.446160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453570+0000","last_change":"2023-08-10T10:29:03.448544+0000","last_active":"2023-08-10T10:29:03.453570+0000","last_peered":"2023-08-10T10:29:03.453570+0000","last_clean":"2023-08-10T10:29:03.453570+0000","last_became_active":"2023-08-10T10:29:03.448140+0000","last_became_peered":"2023-08-10T10:29:03.448140+0000","last_unstale":"2023-08-10T10:29:03.453570+0000","last_undegraded":"2023-08-10T10:29:03.453570+0000","last_fullsized":"2023-08-10T10:29:03.453570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.444473+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:03.444473+0000","last_peered":"2023-08-10T10:29:03.444473+0000","last_clean":"2023-08-10T10:29:03.444473+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:03.444473+0000","last_undegraded":"2023-08-10T10:29:03.444473+0000","last_fullsized":"2023-08-10T10:29:03.444473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:46.819328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436302+0000","last_change":"2023-08-10T10:29:02.508916+0000","last_active":"2023-08-10T10:29:04.436302+0000","last_peered":"2023-08-10T10:29:04.436302+0000","last_clean":"2023-08-10T10:29:04.436302+0000","last_became_active":"2023-08-10T10:29:02.508630+0000","last_became_peered":"2023-08-10T10:29:02.508630+0000","last_unstale":"2023-08-10T10:29:04.436302+0000","last_undegraded":"2023-08-10T10:29:04.436302+0000","last_fullsized":"2023-08-10T10:29:04.436302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:28.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453648+0000","last_change":"2023-08-10T10:29:03.449910+0000","last_active":"2023-08-10T10:29:03.453648+0000","last_peered":"2023-08-10T10:29:03.453648+0000","last_clean":"2023-08-10T10:29:03.453648+0000","last_became_active":"2023-08-10T10:29:03.449231+0000","last_became_peered":"2023-08-10T10:29:03.449231+0000","last_unstale":"2023-08-10T10:29:03.453648+0000","last_undegraded":"2023-08-10T10:29:03.453648+0000","last_fullsized":"2023-08-10T10:29:03.453648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.439045+0000","last_change":"2023-08-10T10:29:02.506926+0000","last_active":"2023-08-10T10:29:03.439045+0000","last_peered":"2023-08-10T10:29:03.439045+0000","last_clean":"2023-08-10T10:29:03.439045+0000","last_became_active":"2023-08-10T10:29:02.506687+0000","last_became_peered":"2023-08-10T10:29:02.506687+0000","last_unstale":"2023-08-10T10:29:03.439045+0000","last_undegraded":"2023-08-10T10:29:03.439045+0000","last_fullsized":"2023-08-10T10:29:03.439045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:54:58.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453781+0000","last_change":"2023-08-10T10:29:03.450582+0000","last_active":"2023-08-10T10:29:03.453781+0000","last_peered":"2023-08-10T10:29:03.453781+0000","last_clean":"2023-08-10T10:29:03.453781+0000","last_became_active":"2023-08-10T10:29:03.450087+0000","last_became_peered":"2023-08-10T10:29:03.450087+0000","last_unstale":"2023-08-10T10:29:03.453781+0000","last_undegraded":"2023-08-10T10:29:03.453781+0000","last_fullsized":"2023-08-10T10:29:03.453781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.438769+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:03.438769+0000","last_peered":"2023-08-10T10:29:03.438769+0000","last_clean":"2023-08-10T10:29:03.438769+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:03.438769+0000","last_undegraded":"2023-08-10T10:29:03.438769+0000","last_fullsized":"2023-08-10T10:29:03.438769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440678+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:04.440678+0000","last_peered":"2023-08-10T10:29:04.440678+0000","last_clean":"2023-08-10T10:29:04.440678+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:04.440678+0000","last_undegraded":"2023-08-10T10:29:04.440678+0000","last_fullsized":"2023-08-10T10:29:04.440678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:15.475871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086186+0000","last_change":"2023-08-10T10:29:02.509636+0000","last_active":"2023-08-10T10:29:06.086186+0000","last_peered":"2023-08-10T10:29:06.086186+0000","last_clean":"2023-08-10T10:29:06.086186+0000","last_became_active":"2023-08-10T10:29:02.509357+0000","last_became_peered":"2023-08-10T10:29:02.509357+0000","last_unstale":"2023-08-10T10:29:06.086186+0000","last_undegraded":"2023-08-10T10:29:06.086186+0000","last_fullsized":"2023-08-10T10:29:06.086186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:10.904417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.445502+0000","last_change":"2023-08-10T10:29:03.443731+0000","last_active":"2023-08-10T10:29:03.445502+0000","last_peered":"2023-08-10T10:29:03.445502+0000","last_clean":"2023-08-10T10:29:03.445502+0000","last_became_active":"2023-08-10T10:29:03.443369+0000","last_became_peered":"2023-08-10T10:29:03.443369+0000","last_unstale":"2023-08-10T10:29:03.445502+0000","last_undegraded":"2023-08-10T10:29:03.445502+0000","last_fullsized":"2023-08-10T10:29:03.445502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:59.873158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440834+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:04.440834+0000","last_peered":"2023-08-10T10:29:04.440834+0000","last_clean":"2023-08-10T10:29:04.440834+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:04.440834+0000","last_undegraded":"2023-08-10T10:29:04.440834+0000","last_fullsized":"2023-08-10T10:29:04.440834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796044+0000","last_change":"2023-08-10T10:29:02.508404+0000","last_active":"2023-08-10T10:29:04.796044+0000","last_peered":"2023-08-10T10:29:04.796044+0000","last_clean":"2023-08-10T10:29:04.796044+0000","last_became_active":"2023-08-10T10:29:02.508118+0000","last_became_peered":"2023-08-10T10:29:02.508118+0000","last_unstale":"2023-08-10T10:29:04.796044+0000","last_undegraded":"2023-08-10T10:29:04.796044+0000","last_fullsized":"2023-08-10T10:29:04.796044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:21.071137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796403+0000","last_change":"2023-08-10T10:29:03.449361+0000","last_active":"2023-08-10T10:29:04.796403+0000","last_peered":"2023-08-10T10:29:04.796403+0000","last_clean":"2023-08-10T10:29:04.796403+0000","last_became_active":"2023-08-10T10:29:03.448855+0000","last_became_peered":"2023-08-10T10:29:03.448855+0000","last_unstale":"2023-08-10T10:29:04.796403+0000","last_undegraded":"2023-08-10T10:29:04.796403+0000","last_fullsized":"2023-08-10T10:29:04.796403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441134+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:04.441134+0000","last_peered":"2023-08-10T10:29:04.441134+0000","last_clean":"2023-08-10T10:29:04.441134+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:04.441134+0000","last_undegraded":"2023-08-10T10:29:04.441134+0000","last_fullsized":"2023-08-10T10:29:04.441134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:24.224979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440349+0000","last_change":"2023-08-10T10:29:02.507620+0000","last_active":"2023-08-10T10:29:03.440349+0000","last_peered":"2023-08-10T10:29:03.440349+0000","last_clean":"2023-08-10T10:29:03.440349+0000","last_became_active":"2023-08-10T10:29:02.507334+0000","last_became_peered":"2023-08-10T10:29:02.507334+0000","last_unstale":"2023-08-10T10:29:03.440349+0000","last_undegraded":"2023-08-10T10:29:03.440349+0000","last_fullsized":"2023-08-10T10:29:03.440349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:13.285418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796133+0000","last_change":"2023-08-10T10:29:03.451179+0000","last_active":"2023-08-10T10:29:04.796133+0000","last_peered":"2023-08-10T10:29:04.796133+0000","last_clean":"2023-08-10T10:29:04.796133+0000","last_became_active":"2023-08-10T10:29:03.450918+0000","last_became_peered":"2023-08-10T10:29:03.450918+0000","last_unstale":"2023-08-10T10:29:04.796133+0000","last_undegraded":"2023-08-10T10:29:04.796133+0000","last_fullsized":"2023-08-10T10:29:04.796133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086651+0000","last_change":"2023-08-10T10:29:02.509567+0000","last_active":"2023-08-10T10:29:06.086651+0000","last_peered":"2023-08-10T10:29:06.086651+0000","last_clean":"2023-08-10T10:29:06.086651+0000","last_became_active":"2023-08-10T10:29:02.509227+0000","last_became_peered":"2023-08-10T10:29:02.509227+0000","last_unstale":"2023-08-10T10:29:06.086651+0000","last_undegraded":"2023-08-10T10:29:06.086651+0000","last_fullsized":"2023-08-10T10:29:06.086651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.440532+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:03.440532+0000","last_peered":"2023-08-10T10:29:03.440532+0000","last_clean":"2023-08-10T10:29:03.440532+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:03.440532+0000","last_undegraded":"2023-08-10T10:29:03.440532+0000","last_fullsized":"2023-08-10T10:29:03.440532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:15.993966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.085979+0000","last_change":"2023-08-10T10:29:03.445049+0000","last_active":"2023-08-10T10:29:06.085979+0000","last_peered":"2023-08-10T10:29:06.085979+0000","last_clean":"2023-08-10T10:29:06.085979+0000","last_became_active":"2023-08-10T10:29:03.444724+0000","last_became_peered":"2023-08-10T10:29:03.444724+0000","last_unstale":"2023-08-10T10:29:06.085979+0000","last_undegraded":"2023-08-10T10:29:06.085979+0000","last_fullsized":"2023-08-10T10:29:06.085979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.437164+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:03.437164+0000","last_peered":"2023-08-10T10:29:03.437164+0000","last_clean":"2023-08-10T10:29:03.437164+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:03.437164+0000","last_undegraded":"2023-08-10T10:29:03.437164+0000","last_fullsized":"2023-08-10T10:29:03.437164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796347+0000","last_change":"2023-08-10T10:29:02.508685+0000","last_active":"2023-08-10T10:29:04.796347+0000","last_peered":"2023-08-10T10:29:04.796347+0000","last_clean":"2023-08-10T10:29:04.796347+0000","last_became_active":"2023-08-10T10:29:02.508376+0000","last_became_peered":"2023-08-10T10:29:02.508376+0000","last_unstale":"2023-08-10T10:29:04.796347+0000","last_undegraded":"2023-08-10T10:29:04.796347+0000","last_fullsized":"2023-08-10T10:29:04.796347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435479+0000","last_change":"2023-08-10T10:29:03.449122+0000","last_active":"2023-08-10T10:29:04.435479+0000","last_peered":"2023-08-10T10:29:04.435479+0000","last_clean":"2023-08-10T10:29:04.435479+0000","last_became_active":"2023-08-10T10:29:03.448040+0000","last_became_peered":"2023-08-10T10:29:03.448040+0000","last_unstale":"2023-08-10T10:29:04.435479+0000","last_undegraded":"2023-08-10T10:29:04.435479+0000","last_fullsized":"2023-08-10T10:29:04.435479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796191+0000","last_change":"2023-08-10T10:29:02.511445+0000","last_active":"2023-08-10T10:29:04.796191+0000","last_peered":"2023-08-10T10:29:04.796191+0000","last_clean":"2023-08-10T10:29:04.796191+0000","last_became_active":"2023-08-10T10:29:02.511184+0000","last_became_peered":"2023-08-10T10:29:02.511184+0000","last_unstale":"2023-08-10T10:29:04.796191+0000","last_undegraded":"2023-08-10T10:29:04.796191+0000","last_fullsized":"2023-08-10T10:29:04.796191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.500889+0000","last_change":"2023-08-10T10:29:02.506009+0000","last_active":"2023-08-10T10:29:03.500889+0000","last_peered":"2023-08-10T10:29:03.500889+0000","last_clean":"2023-08-10T10:29:03.500889+0000","last_became_active":"2023-08-10T10:29:02.505751+0000","last_became_peered":"2023-08-10T10:29:02.505751+0000","last_unstale":"2023-08-10T10:29:03.500889+0000","last_undegraded":"2023-08-10T10:29:03.500889+0000","last_fullsized":"2023-08-10T10:29:03.500889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:33.933799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436211+0000","last_change":"2023-08-10T10:29:03.440207+0000","last_active":"2023-08-10T10:29:04.436211+0000","last_peered":"2023-08-10T10:29:04.436211+0000","last_clean":"2023-08-10T10:29:04.436211+0000","last_became_active":"2023-08-10T10:29:03.439702+0000","last_became_peered":"2023-08-10T10:29:03.439702+0000","last_unstale":"2023-08-10T10:29:04.436211+0000","last_undegraded":"2023-08-10T10:29:04.436211+0000","last_fullsized":"2023-08-10T10:29:04.436211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.501395+0000","last_change":"2023-08-10T10:29:02.507533+0000","last_active":"2023-08-10T10:29:03.501395+0000","last_peered":"2023-08-10T10:29:03.501395+0000","last_clean":"2023-08-10T10:29:03.501395+0000","last_became_active":"2023-08-10T10:29:02.507215+0000","last_became_peered":"2023-08-10T10:29:02.507215+0000","last_unstale":"2023-08-10T10:29:03.501395+0000","last_undegraded":"2023-08-10T10:29:03.501395+0000","last_fullsized":"2023-08-10T10:29:03.501395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:20.179333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436223+0000","last_change":"2023-08-10T10:29:03.440169+0000","last_active":"2023-08-10T10:29:04.436223+0000","last_peered":"2023-08-10T10:29:04.436223+0000","last_clean":"2023-08-10T10:29:04.436223+0000","last_became_active":"2023-08-10T10:29:03.439746+0000","last_became_peered":"2023-08-10T10:29:03.439746+0000","last_unstale":"2023-08-10T10:29:04.436223+0000","last_undegraded":"2023-08-10T10:29:04.436223+0000","last_fullsized":"2023-08-10T10:29:04.436223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086444+0000","last_change":"2023-08-10T10:29:02.508038+0000","last_active":"2023-08-10T10:29:06.086444+0000","last_peered":"2023-08-10T10:29:06.086444+0000","last_clean":"2023-08-10T10:29:06.086444+0000","last_became_active":"2023-08-10T10:29:02.507705+0000","last_became_peered":"2023-08-10T10:29:02.507705+0000","last_unstale":"2023-08-10T10:29:06.086444+0000","last_undegraded":"2023-08-10T10:29:06.086444+0000","last_fullsized":"2023-08-10T10:29:06.086444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086412+0000","last_change":"2023-08-10T10:29:03.439576+0000","last_active":"2023-08-10T10:29:06.086412+0000","last_peered":"2023-08-10T10:29:06.086412+0000","last_clean":"2023-08-10T10:29:06.086412+0000","last_became_active":"2023-08-10T10:29:03.439303+0000","last_became_peered":"2023-08-10T10:29:03.439303+0000","last_unstale":"2023-08-10T10:29:06.086412+0000","last_undegraded":"2023-08-10T10:29:06.086412+0000","last_fullsized":"2023-08-10T10:29:06.086412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796395+0000","last_change":"2023-08-10T10:29:02.514204+0000","last_active":"2023-08-10T10:29:04.796395+0000","last_peered":"2023-08-10T10:29:04.796395+0000","last_clean":"2023-08-10T10:29:04.796395+0000","last_became_active":"2023-08-10T10:29:02.514038+0000","last_became_peered":"2023-08-10T10:29:02.514038+0000","last_unstale":"2023-08-10T10:29:04.796395+0000","last_undegraded":"2023-08-10T10:29:04.796395+0000","last_fullsized":"2023-08-10T10:29:04.796395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435320+0000","last_change":"2023-08-10T10:29:03.440843+0000","last_active":"2023-08-10T10:29:04.435320+0000","last_peered":"2023-08-10T10:29:04.435320+0000","last_clean":"2023-08-10T10:29:04.435320+0000","last_became_active":"2023-08-10T10:29:03.440587+0000","last_became_peered":"2023-08-10T10:29:03.440587+0000","last_unstale":"2023-08-10T10:29:04.435320+0000","last_undegraded":"2023-08-10T10:29:04.435320+0000","last_fullsized":"2023-08-10T10:29:04.435320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.450264+0000","last_change":"2023-08-10T10:29:03.448796+0000","last_active":"2023-08-10T10:29:03.450264+0000","last_peered":"2023-08-10T10:29:03.450264+0000","last_clean":"2023-08-10T10:29:03.450264+0000","last_became_active":"2023-08-10T10:29:03.448489+0000","last_became_peered":"2023-08-10T10:29:03.448489+0000","last_unstale":"2023-08-10T10:29:03.450264+0000","last_undegraded":"2023-08-10T10:29:03.450264+0000","last_fullsized":"2023-08-10T10:29:03.450264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:46.223040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086033+0000","last_change":"2023-08-10T10:29:03.441287+0000","last_active":"2023-08-10T10:29:06.086033+0000","last_peered":"2023-08-10T10:29:06.086033+0000","last_clean":"2023-08-10T10:29:06.086033+0000","last_became_active":"2023-08-10T10:29:03.441023+0000","last_became_peered":"2023-08-10T10:29:03.441023+0000","last_unstale":"2023-08-10T10:29:06.086033+0000","last_undegraded":"2023-08-10T10:29:06.086033+0000","last_fullsized":"2023-08-10T10:29:06.086033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435948+0000","last_change":"2023-08-10T10:29:03.442345+0000","last_active":"2023-08-10T10:29:04.435948+0000","last_peered":"2023-08-10T10:29:04.435948+0000","last_clean":"2023-08-10T10:29:04.435948+0000","last_became_active":"2023-08-10T10:29:03.441657+0000","last_became_peered":"2023-08-10T10:29:03.441657+0000","last_unstale":"2023-08-10T10:29:04.435948+0000","last_undegraded":"2023-08-10T10:29:04.435948+0000","last_fullsized":"2023-08-10T10:29:04.435948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086339+0000","last_change":"2023-08-10T10:29:03.447084+0000","last_active":"2023-08-10T10:29:06.086339+0000","last_peered":"2023-08-10T10:29:06.086339+0000","last_clean":"2023-08-10T10:29:06.086339+0000","last_became_active":"2023-08-10T10:29:03.446803+0000","last_became_peered":"2023-08-10T10:29:03.446803+0000","last_unstale":"2023-08-10T10:29:06.086339+0000","last_undegraded":"2023-08-10T10:29:06.086339+0000","last_fullsized":"2023-08-10T10:29:06.086339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:29:03.453612+0000","last_change":"2023-08-10T10:29:03.449287+0000","last_active":"2023-08-10T10:29:03.453612+0000","last_peered":"2023-08-10T10:29:03.453612+0000","last_clean":"2023-08-10T10:29:03.453612+0000","last_became_active":"2023-08-10T10:29:03.448995+0000","last_became_peered":"2023-08-10T10:29:03.448995+0000","last_unstale":"2023-08-10T10:29:03.453612+0000","last_undegraded":"2023-08-10T10:29:03.453612+0000","last_fullsized":"2023-08-10T10:29:03.453612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:56.439088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":87707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":88269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:09.425 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:29:09.424+0000 7f440abd0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:29:12.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:12.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.338+0000 7f020e6fd700 1 Processor -- start 2023-08-10T10:29:12.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.338+0000 7f020e6fd700 1 -- start start 2023-08-10T10:29:12.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f020e6fd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02080cdd80 0x7f02080d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f020e6fd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080cbd50 con 0x7f02081609f0 2023-08-10T10:29:12.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f020e6fd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080cb440 con 0x7f0208160610 2023-08-10T10:29:12.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f020e6fd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080d0250 con 0x7f02080cdd80 2023-08-10T10:29:12.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f02077fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f02081609f0 0x7f02080cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36936/0 (socket says 172.21.15.161:36936) 2023-08-10T10:29:12.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f02077fe700 1 -- 172.21.15.161:0/4152864662 learned_addr learned my addr 172.21.15.161:0/4152864662 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:12.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667551707 0 0) 0x7f02080cbd50 con 0x7f02081609f0 2023-08-10T10:29:12.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f40035b0 con 0x7f02081609f0 2023-08-10T10:29:12.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.339+0000 7f020cc9a700 1 --2- 172.21.15.161:0/4152864662 >> v2:172.21.15.175:3300/0 conn(0x7f02080cdd80 0x7f02080d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702184913 0 0) 0x7f01f40035b0 con 0x7f02081609f0 2023-08-10T10:29:12.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 >> v2:172.21.15.175:3300/0 conn(0x7f02080cdd80 msgr2=0x7f02080d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:12.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 --2- 172.21.15.161:0/4152864662 >> v2:172.21.15.175:3300/0 conn(0x7f02080cdd80 0x7f02080d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 >> v1:172.21.15.175:6789/0 conn(0x7f0208160610 legacy=0x7f02080cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080cb700 con 0x7f02081609f0 2023-08-10T10:29:12.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f01f0001670 con 0x7f02081609f0 2023-08-10T10:29:12.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 >> v1:172.21.15.161:6789/0 conn(0x7f02081609f0 legacy=0x7f02080cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 0x7f01f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f4004850 0x7f01f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4005210 0x7f01f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080d0250 con 0x7f01f4003a00 2023-08-10T10:29:12.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f400c0b0 con 0x7f01f4004850 2023-08-10T10:29:12.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f400c270 con 0x7f01f4005210 2023-08-10T10:29:12.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 0x7f01f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f02077fe700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f4004850 0x7f01f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f020cc9a700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4005210 0x7f01f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 -- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4005210 msgr2=0x7f01f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:12.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4005210 0x7f01f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 -- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f4004850 msgr2=0x7f01f4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:12.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f4004850 0x7f01f4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 -- 172.21.15.161:0/4152864662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40035b0 con 0x7f01f4003a00 2023-08-10T10:29:12.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f020cc9a700 1 -- 172.21.15.161:0/4152864662 reap_dead start 2023-08-10T10:29:12.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.340+0000 7f0207fff700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 0x7f01f4003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01f8001860 tx=0x7f01f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b23a2111477a98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8001320 con 0x7f01f4003a00 2023-08-10T10:29:12.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8005310 con 0x7f01f4003a00 2023-08-10T10:29:12.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f0206ffd700 1 -- 172.21.15.161:0/4152864662 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80068b0 con 0x7f01f4003a00 2023-08-10T10:29:12.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 -- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 msgr2=0x7f01f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 0x7f01f4003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01f8001860 tx=0x7f01f4005880 comp rx=0 tx=0).stop 2023-08-10T10:29:12.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 -- 172.21.15.161:0/4152864662 shutdown_connections 2023-08-10T10:29:12.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4152864662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f4003a00 0x7f01f4003e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 -- 172.21.15.161:0/4152864662 >> 172.21.15.161:0/4152864662 conn(0x7f020809a150 msgr2=0x7f02080d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:12.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 -- 172.21.15.161:0/4152864662 shutdown_connections 2023-08-10T10:29:12.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.341+0000 7f020e6fd700 1 -- 172.21.15.161:0/4152864662 wait complete. 2023-08-10T10:29:12.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.342+0000 7f020e6fd700 1 Processor -- start 2023-08-10T10:29:12.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 -- start start 2023-08-10T10:29:12.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 0x7f02080ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 0x7f02080b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cae20 con 0x7f02080b5c30 2023-08-10T10:29:12.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080b4780 con 0x7f02080b3dc0 2023-08-10T10:29:12.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020e6fd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208159ba0 con 0x7f01f4003a00 2023-08-10T10:29:12.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020cc9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020cc9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59944/0 (socket says 172.21.15.161:59944) 2023-08-10T10:29:12.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.343+0000 7f020cc9a700 1 -- 172.21.15.161:0/4070799844 learned_addr learned my addr 172.21.15.161:0/4070799844 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:12.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f02077fe700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 0x7f02080b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f0207fff700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 0x7f02080ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 -- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 msgr2=0x7f02080ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 0x7f02080ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 -- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 msgr2=0x7f02080b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 0x7f02080b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 -- 172.21.15.161:0/4070799844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020815a160 con 0x7f02080b5c30 2023-08-10T10:29:12.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f02077fe700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 0x7f02080b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:12.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f0207fff700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 0x7f02080ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:12.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020cc9a700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02080d0b50 tx=0x7f0200011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000e040 con 0x7f02080b5c30 2023-08-10T10:29:12.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000f040 con 0x7f02080b5c30 2023-08-10T10:29:12.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02080b65f0 con 0x7f02080b5c30 2023-08-10T10:29:12.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000f8c0 con 0x7f02080b5c30 2023-08-10T10:29:12.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.344+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02080b6b80 con 0x7f02080b5c30 2023-08-10T10:29:12.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.345+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02080744e0 con 0x7f02080b5c30 2023-08-10T10:29:12.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.346+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f020000fa20 con 0x7f02080b5c30 2023-08-10T10:29:12.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.346+0000 7f0204ff9700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 0x7f01e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.346+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0200089910 con 0x7f02080b5c30 2023-08-10T10:29:12.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.346+0000 7f0207fff700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 0x7f01e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.346+0000 7f0207fff700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 0x7f01e806d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f8001860 tx=0x7f01f8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.350+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0200058450 con 0x7f02080b5c30 2023-08-10T10:29:12.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.536+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02080cb9e0 con 0x7f01e806ace0 2023-08-10T10:29:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.543+0000 7f0204ff9700 1 -- 172.21.15.161:0/4070799844 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286715 (secure 0 0 0) 0x7f01f80012c0 con 0x7f01e806ace0 2023-08-10T10:29:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 msgr2=0x7f01e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 0x7f01e806d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f8001860 tx=0x7f01f8009030 comp rx=0 tx=0).stop 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 msgr2=0x7f02080b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02080d0b50 tx=0x7f0200011ed0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 shutdown_connections 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f01e806ace0 0x7f01e806d1a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02080b5c30 0x7f02080b60b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f4003a00 0x7f02080ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 --2- 172.21.15.161:0/4070799844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02080b3dc0 0x7f02080b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 >> 172.21.15.161:0/4070799844 conn(0x7f020809a150 msgr2=0x7f020806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 shutdown_connections 2023-08-10T10:29:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.547+0000 7f020e6fd700 1 -- 172.21.15.161:0/4070799844 wait complete. 2023-08-10T10:29:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:12.560 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-10T10:29:12.188682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.758902"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344646+0000","last_change":"2023-08-10T10:29:03.450108+0000","last_active":"2023-08-10T10:29:06.344646+0000","last_peered":"2023-08-10T10:29:06.344646+0000","last_clean":"2023-08-10T10:29:06.344646+0000","last_became_active":"2023-08-10T10:29:03.449434+0000","last_became_peered":"2023-08-10T10:29:03.449434+0000","last_unstale":"2023-08-10T10:29:06.344646+0000","last_undegraded":"2023-08-10T10:29:06.344646+0000","last_fullsized":"2023-08-10T10:29:06.344646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:03.644957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435719+0000","last_change":"2023-08-10T10:29:03.449144+0000","last_active":"2023-08-10T10:29:04.435719+0000","last_peered":"2023-08-10T10:29:04.435719+0000","last_clean":"2023-08-10T10:29:04.435719+0000","last_became_active":"2023-08-10T10:29:03.448690+0000","last_became_peered":"2023-08-10T10:29:03.448690+0000","last_unstale":"2023-08-10T10:29:04.435719+0000","last_undegraded":"2023-08-10T10:29:04.435719+0000","last_fullsized":"2023-08-10T10:29:04.435719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564510+0000","last_change":"2023-08-10T10:29:03.448973+0000","last_active":"2023-08-10T10:29:06.564510+0000","last_peered":"2023-08-10T10:29:06.564510+0000","last_clean":"2023-08-10T10:29:06.564510+0000","last_became_active":"2023-08-10T10:29:03.448666+0000","last_became_peered":"2023-08-10T10:29:03.448666+0000","last_unstale":"2023-08-10T10:29:06.564510+0000","last_undegraded":"2023-08-10T10:29:06.564510+0000","last_fullsized":"2023-08-10T10:29:06.564510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:38.594843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.795980+0000","last_change":"2023-08-10T10:29:03.451710+0000","last_active":"2023-08-10T10:29:04.795980+0000","last_peered":"2023-08-10T10:29:04.795980+0000","last_clean":"2023-08-10T10:29:04.795980+0000","last_became_active":"2023-08-10T10:29:03.451411+0000","last_became_peered":"2023-08-10T10:29:03.451411+0000","last_unstale":"2023-08-10T10:29:04.795980+0000","last_undegraded":"2023-08-10T10:29:04.795980+0000","last_fullsized":"2023-08-10T10:29:04.795980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435794+0000","last_change":"2023-08-10T10:29:03.451672+0000","last_active":"2023-08-10T10:29:04.435794+0000","last_peered":"2023-08-10T10:29:04.435794+0000","last_clean":"2023-08-10T10:29:04.435794+0000","last_became_active":"2023-08-10T10:29:03.451376+0000","last_became_peered":"2023-08-10T10:29:03.451376+0000","last_unstale":"2023-08-10T10:29:04.435794+0000","last_undegraded":"2023-08-10T10:29:04.435794+0000","last_fullsized":"2023-08-10T10:29:04.435794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440823+0000","last_change":"2023-08-10T10:29:03.444231+0000","last_active":"2023-08-10T10:29:04.440823+0000","last_peered":"2023-08-10T10:29:04.440823+0000","last_clean":"2023-08-10T10:29:04.440823+0000","last_became_active":"2023-08-10T10:29:03.443264+0000","last_became_peered":"2023-08-10T10:29:03.443264+0000","last_unstale":"2023-08-10T10:29:04.440823+0000","last_undegraded":"2023-08-10T10:29:04.440823+0000","last_fullsized":"2023-08-10T10:29:04.440823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344469+0000","last_change":"2023-08-10T10:29:03.447620+0000","last_active":"2023-08-10T10:29:06.344469+0000","last_peered":"2023-08-10T10:29:06.344469+0000","last_clean":"2023-08-10T10:29:06.344469+0000","last_became_active":"2023-08-10T10:29:03.447339+0000","last_became_peered":"2023-08-10T10:29:03.447339+0000","last_unstale":"2023-08-10T10:29:06.344469+0000","last_undegraded":"2023-08-10T10:29:06.344469+0000","last_fullsized":"2023-08-10T10:29:06.344469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796204+0000","last_change":"2023-08-10T10:29:03.450118+0000","last_active":"2023-08-10T10:29:04.796204+0000","last_peered":"2023-08-10T10:29:04.796204+0000","last_clean":"2023-08-10T10:29:04.796204+0000","last_became_active":"2023-08-10T10:29:03.449864+0000","last_became_peered":"2023-08-10T10:29:03.449864+0000","last_unstale":"2023-08-10T10:29:04.796204+0000","last_undegraded":"2023-08-10T10:29:04.796204+0000","last_fullsized":"2023-08-10T10:29:04.796204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344921+0000","last_change":"2023-08-10T10:29:03.451715+0000","last_active":"2023-08-10T10:29:06.344921+0000","last_peered":"2023-08-10T10:29:06.344921+0000","last_clean":"2023-08-10T10:29:06.344921+0000","last_became_active":"2023-08-10T10:29:03.451414+0000","last_became_peered":"2023-08-10T10:29:03.451414+0000","last_unstale":"2023-08-10T10:29:06.344921+0000","last_undegraded":"2023-08-10T10:29:06.344921+0000","last_fullsized":"2023-08-10T10:29:06.344921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435674+0000","last_change":"2023-08-10T10:29:03.443457+0000","last_active":"2023-08-10T10:29:04.435674+0000","last_peered":"2023-08-10T10:29:04.435674+0000","last_clean":"2023-08-10T10:29:04.435674+0000","last_became_active":"2023-08-10T10:29:03.443182+0000","last_became_peered":"2023-08-10T10:29:03.443182+0000","last_unstale":"2023-08-10T10:29:04.435674+0000","last_undegraded":"2023-08-10T10:29:04.435674+0000","last_fullsized":"2023-08-10T10:29:04.435674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344714+0000","last_change":"2023-08-10T10:29:03.448673+0000","last_active":"2023-08-10T10:29:06.344714+0000","last_peered":"2023-08-10T10:29:06.344714+0000","last_clean":"2023-08-10T10:29:06.344714+0000","last_became_active":"2023-08-10T10:29:03.448378+0000","last_became_peered":"2023-08-10T10:29:03.448378+0000","last_unstale":"2023-08-10T10:29:06.344714+0000","last_undegraded":"2023-08-10T10:29:06.344714+0000","last_fullsized":"2023-08-10T10:29:06.344714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441146+0000","last_change":"2023-08-10T10:29:03.445496+0000","last_active":"2023-08-10T10:29:04.441146+0000","last_peered":"2023-08-10T10:29:04.441146+0000","last_clean":"2023-08-10T10:29:04.441146+0000","last_became_active":"2023-08-10T10:29:03.445239+0000","last_became_peered":"2023-08-10T10:29:03.445239+0000","last_unstale":"2023-08-10T10:29:04.441146+0000","last_undegraded":"2023-08-10T10:29:04.441146+0000","last_fullsized":"2023-08-10T10:29:04.441146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:50.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.451219+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.450957+0000","last_became_peered":"2023-08-10T10:29:03.450957+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:22.072828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796266+0000","last_change":"2023-08-10T10:29:03.450677+0000","last_active":"2023-08-10T10:29:04.796266+0000","last_peered":"2023-08-10T10:29:04.796266+0000","last_clean":"2023-08-10T10:29:04.796266+0000","last_became_active":"2023-08-10T10:29:03.450414+0000","last_became_peered":"2023-08-10T10:29:03.450414+0000","last_unstale":"2023-08-10T10:29:04.796266+0000","last_undegraded":"2023-08-10T10:29:04.796266+0000","last_fullsized":"2023-08-10T10:29:04.796266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435726+0000","last_change":"2023-08-10T10:29:03.448733+0000","last_active":"2023-08-10T10:29:04.435726+0000","last_peered":"2023-08-10T10:29:04.435726+0000","last_clean":"2023-08-10T10:29:04.435726+0000","last_became_active":"2023-08-10T10:29:03.448379+0000","last_became_peered":"2023-08-10T10:29:03.448379+0000","last_unstale":"2023-08-10T10:29:04.435726+0000","last_undegraded":"2023-08-10T10:29:04.435726+0000","last_fullsized":"2023-08-10T10:29:04.435726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435953+0000","last_change":"2023-08-10T10:29:03.442226+0000","last_active":"2023-08-10T10:29:04.435953+0000","last_peered":"2023-08-10T10:29:04.435953+0000","last_clean":"2023-08-10T10:29:04.435953+0000","last_became_active":"2023-08-10T10:29:03.441986+0000","last_became_peered":"2023-08-10T10:29:03.441986+0000","last_unstale":"2023-08-10T10:29:04.435953+0000","last_undegraded":"2023-08-10T10:29:04.435953+0000","last_fullsized":"2023-08-10T10:29:04.435953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441131+0000","last_change":"2023-08-10T10:29:03.447854+0000","last_active":"2023-08-10T10:29:04.441131+0000","last_peered":"2023-08-10T10:29:04.441131+0000","last_clean":"2023-08-10T10:29:04.441131+0000","last_became_active":"2023-08-10T10:29:03.447513+0000","last_became_peered":"2023-08-10T10:29:03.447513+0000","last_unstale":"2023-08-10T10:29:04.441131+0000","last_undegraded":"2023-08-10T10:29:04.441131+0000","last_fullsized":"2023-08-10T10:29:04.441131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796072+0000","last_change":"2023-08-10T10:29:03.450633+0000","last_active":"2023-08-10T10:29:04.796072+0000","last_peered":"2023-08-10T10:29:04.796072+0000","last_clean":"2023-08-10T10:29:04.796072+0000","last_became_active":"2023-08-10T10:29:03.450345+0000","last_became_peered":"2023-08-10T10:29:03.450345+0000","last_unstale":"2023-08-10T10:29:04.796072+0000","last_undegraded":"2023-08-10T10:29:04.796072+0000","last_fullsized":"2023-08-10T10:29:04.796072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086320+0000","last_change":"2023-08-10T10:29:03.451595+0000","last_active":"2023-08-10T10:29:06.086320+0000","last_peered":"2023-08-10T10:29:06.086320+0000","last_clean":"2023-08-10T10:29:06.086320+0000","last_became_active":"2023-08-10T10:29:03.451277+0000","last_became_peered":"2023-08-10T10:29:03.451277+0000","last_unstale":"2023-08-10T10:29:06.086320+0000","last_undegraded":"2023-08-10T10:29:06.086320+0000","last_fullsized":"2023-08-10T10:29:06.086320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440927+0000","last_change":"2023-08-10T10:29:03.448073+0000","last_active":"2023-08-10T10:29:04.440927+0000","last_peered":"2023-08-10T10:29:04.440927+0000","last_clean":"2023-08-10T10:29:04.440927+0000","last_became_active":"2023-08-10T10:29:03.447608+0000","last_became_peered":"2023-08-10T10:29:03.447608+0000","last_unstale":"2023-08-10T10:29:04.440927+0000","last_undegraded":"2023-08-10T10:29:04.440927+0000","last_fullsized":"2023-08-10T10:29:04.440927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454476+0000","last_change":"2023-08-10T10:29:03.444304+0000","last_active":"2023-08-10T10:29:06.454476+0000","last_peered":"2023-08-10T10:29:06.454476+0000","last_clean":"2023-08-10T10:29:06.454476+0000","last_became_active":"2023-08-10T10:29:03.441797+0000","last_became_peered":"2023-08-10T10:29:03.441797+0000","last_unstale":"2023-08-10T10:29:06.454476+0000","last_undegraded":"2023-08-10T10:29:06.454476+0000","last_fullsized":"2023-08-10T10:29:06.454476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454588+0000","last_change":"2023-08-10T10:29:03.448858+0000","last_active":"2023-08-10T10:29:06.454588+0000","last_peered":"2023-08-10T10:29:06.454588+0000","last_clean":"2023-08-10T10:29:06.454588+0000","last_became_active":"2023-08-10T10:29:03.448575+0000","last_became_peered":"2023-08-10T10:29:03.448575+0000","last_unstale":"2023-08-10T10:29:06.454588+0000","last_undegraded":"2023-08-10T10:29:06.454588+0000","last_fullsized":"2023-08-10T10:29:06.454588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344741+0000","last_change":"2023-08-10T10:29:03.449820+0000","last_active":"2023-08-10T10:29:06.344741+0000","last_peered":"2023-08-10T10:29:06.344741+0000","last_clean":"2023-08-10T10:29:06.344741+0000","last_became_active":"2023-08-10T10:29:03.449280+0000","last_became_peered":"2023-08-10T10:29:03.449280+0000","last_unstale":"2023-08-10T10:29:06.344741+0000","last_undegraded":"2023-08-10T10:29:06.344741+0000","last_fullsized":"2023-08-10T10:29:06.344741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436273+0000","last_change":"2023-08-10T10:29:02.509556+0000","last_active":"2023-08-10T10:29:04.436273+0000","last_peered":"2023-08-10T10:29:04.436273+0000","last_clean":"2023-08-10T10:29:04.436273+0000","last_became_active":"2023-08-10T10:29:02.509283+0000","last_became_peered":"2023-08-10T10:29:02.509283+0000","last_unstale":"2023-08-10T10:29:04.436273+0000","last_undegraded":"2023-08-10T10:29:04.436273+0000","last_fullsized":"2023-08-10T10:29:04.436273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086441+0000","last_change":"2023-08-10T10:29:03.443570+0000","last_active":"2023-08-10T10:29:06.086441+0000","last_peered":"2023-08-10T10:29:06.086441+0000","last_clean":"2023-08-10T10:29:06.086441+0000","last_became_active":"2023-08-10T10:29:03.443302+0000","last_became_peered":"2023-08-10T10:29:03.443302+0000","last_unstale":"2023-08-10T10:29:06.086441+0000","last_undegraded":"2023-08-10T10:29:06.086441+0000","last_fullsized":"2023-08-10T10:29:06.086441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454280+0000","last_change":"2023-08-10T10:29:02.510076+0000","last_active":"2023-08-10T10:29:06.454280+0000","last_peered":"2023-08-10T10:29:06.454280+0000","last_clean":"2023-08-10T10:29:06.454280+0000","last_became_active":"2023-08-10T10:29:02.509806+0000","last_became_peered":"2023-08-10T10:29:02.509806+0000","last_unstale":"2023-08-10T10:29:06.454280+0000","last_undegraded":"2023-08-10T10:29:06.454280+0000","last_fullsized":"2023-08-10T10:29:06.454280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796264+0000","last_change":"2023-08-10T10:29:03.450711+0000","last_active":"2023-08-10T10:29:04.796264+0000","last_peered":"2023-08-10T10:29:04.796264+0000","last_clean":"2023-08-10T10:29:04.796264+0000","last_became_active":"2023-08-10T10:29:03.450363+0000","last_became_peered":"2023-08-10T10:29:03.450363+0000","last_unstale":"2023-08-10T10:29:04.796264+0000","last_undegraded":"2023-08-10T10:29:04.796264+0000","last_fullsized":"2023-08-10T10:29:04.796264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086179+0000","last_change":"2023-08-10T10:29:02.509352+0000","last_active":"2023-08-10T10:29:06.086179+0000","last_peered":"2023-08-10T10:29:06.086179+0000","last_clean":"2023-08-10T10:29:06.086179+0000","last_became_active":"2023-08-10T10:29:02.509050+0000","last_became_peered":"2023-08-10T10:29:02.509050+0000","last_unstale":"2023-08-10T10:29:06.086179+0000","last_undegraded":"2023-08-10T10:29:06.086179+0000","last_fullsized":"2023-08-10T10:29:06.086179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:03.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564688+0000","last_change":"2023-08-10T10:29:03.449521+0000","last_active":"2023-08-10T10:29:06.564688+0000","last_peered":"2023-08-10T10:29:06.564688+0000","last_clean":"2023-08-10T10:29:06.564688+0000","last_became_active":"2023-08-10T10:29:03.449254+0000","last_became_peered":"2023-08-10T10:29:03.449254+0000","last_unstale":"2023-08-10T10:29:06.564688+0000","last_undegraded":"2023-08-10T10:29:06.564688+0000","last_fullsized":"2023-08-10T10:29:06.564688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:52.435268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796291+0000","last_change":"2023-08-10T10:29:02.514169+0000","last_active":"2023-08-10T10:29:04.796291+0000","last_peered":"2023-08-10T10:29:04.796291+0000","last_clean":"2023-08-10T10:29:04.796291+0000","last_became_active":"2023-08-10T10:29:02.513967+0000","last_became_peered":"2023-08-10T10:29:02.513967+0000","last_unstale":"2023-08-10T10:29:04.796291+0000","last_undegraded":"2023-08-10T10:29:04.796291+0000","last_fullsized":"2023-08-10T10:29:04.796291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086126+0000","last_change":"2023-08-10T10:29:03.440626+0000","last_active":"2023-08-10T10:29:06.086126+0000","last_peered":"2023-08-10T10:29:06.086126+0000","last_clean":"2023-08-10T10:29:06.086126+0000","last_became_active":"2023-08-10T10:29:03.440266+0000","last_became_peered":"2023-08-10T10:29:03.440266+0000","last_unstale":"2023-08-10T10:29:06.086126+0000","last_undegraded":"2023-08-10T10:29:06.086126+0000","last_fullsized":"2023-08-10T10:29:06.086126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344756+0000","last_change":"2023-08-10T10:29:02.505024+0000","last_active":"2023-08-10T10:29:06.344756+0000","last_peered":"2023-08-10T10:29:06.344756+0000","last_clean":"2023-08-10T10:29:06.344756+0000","last_became_active":"2023-08-10T10:29:02.504178+0000","last_became_peered":"2023-08-10T10:29:02.504178+0000","last_unstale":"2023-08-10T10:29:06.344756+0000","last_undegraded":"2023-08-10T10:29:06.344756+0000","last_fullsized":"2023-08-10T10:29:06.344756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:18.093416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086183+0000","last_change":"2023-08-10T10:29:03.444252+0000","last_active":"2023-08-10T10:29:06.086183+0000","last_peered":"2023-08-10T10:29:06.086183+0000","last_clean":"2023-08-10T10:29:06.086183+0000","last_became_active":"2023-08-10T10:29:03.443982+0000","last_became_peered":"2023-08-10T10:29:03.443982+0000","last_unstale":"2023-08-10T10:29:06.086183+0000","last_undegraded":"2023-08-10T10:29:06.086183+0000","last_fullsized":"2023-08-10T10:29:06.086183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441209+0000","last_change":"2023-08-10T10:29:02.510256+0000","last_active":"2023-08-10T10:29:04.441209+0000","last_peered":"2023-08-10T10:29:04.441209+0000","last_clean":"2023-08-10T10:29:04.441209+0000","last_became_active":"2023-08-10T10:29:02.510054+0000","last_became_peered":"2023-08-10T10:29:02.510054+0000","last_unstale":"2023-08-10T10:29:04.441209+0000","last_undegraded":"2023-08-10T10:29:04.441209+0000","last_fullsized":"2023-08-10T10:29:04.441209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:03.509285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454279+0000","last_change":"2023-08-10T10:29:03.442886+0000","last_active":"2023-08-10T10:29:06.454279+0000","last_peered":"2023-08-10T10:29:06.454279+0000","last_clean":"2023-08-10T10:29:06.454279+0000","last_became_active":"2023-08-10T10:29:03.442103+0000","last_became_peered":"2023-08-10T10:29:03.442103+0000","last_unstale":"2023-08-10T10:29:06.454279+0000","last_undegraded":"2023-08-10T10:29:06.454279+0000","last_fullsized":"2023-08-10T10:29:06.454279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436220+0000","last_change":"2023-08-10T10:29:02.504354+0000","last_active":"2023-08-10T10:29:04.436220+0000","last_peered":"2023-08-10T10:29:04.436220+0000","last_clean":"2023-08-10T10:29:04.436220+0000","last_became_active":"2023-08-10T10:29:02.503879+0000","last_became_peered":"2023-08-10T10:29:02.503879+0000","last_unstale":"2023-08-10T10:29:04.436220+0000","last_undegraded":"2023-08-10T10:29:04.436220+0000","last_fullsized":"2023-08-10T10:29:04.436220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436378+0000","last_change":"2023-08-10T10:29:03.440803+0000","last_active":"2023-08-10T10:29:04.436378+0000","last_peered":"2023-08-10T10:29:04.436378+0000","last_clean":"2023-08-10T10:29:04.436378+0000","last_became_active":"2023-08-10T10:29:03.440491+0000","last_became_peered":"2023-08-10T10:29:03.440491+0000","last_unstale":"2023-08-10T10:29:04.436378+0000","last_undegraded":"2023-08-10T10:29:04.436378+0000","last_fullsized":"2023-08-10T10:29:04.436378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:04.510976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441036+0000","last_change":"2023-08-10T10:29:02.506354+0000","last_active":"2023-08-10T10:29:04.441036+0000","last_peered":"2023-08-10T10:29:04.441036+0000","last_clean":"2023-08-10T10:29:04.441036+0000","last_became_active":"2023-08-10T10:29:02.506110+0000","last_became_peered":"2023-08-10T10:29:02.506110+0000","last_unstale":"2023-08-10T10:29:04.441036+0000","last_undegraded":"2023-08-10T10:29:04.441036+0000","last_fullsized":"2023-08-10T10:29:04.441036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.953593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086288+0000","last_change":"2023-08-10T10:29:03.443853+0000","last_active":"2023-08-10T10:29:06.086288+0000","last_peered":"2023-08-10T10:29:06.086288+0000","last_clean":"2023-08-10T10:29:06.086288+0000","last_became_active":"2023-08-10T10:29:03.443591+0000","last_became_peered":"2023-08-10T10:29:03.443591+0000","last_unstale":"2023-08-10T10:29:06.086288+0000","last_undegraded":"2023-08-10T10:29:06.086288+0000","last_fullsized":"2023-08-10T10:29:06.086288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796014+0000","last_change":"2023-08-10T10:29:02.508938+0000","last_active":"2023-08-10T10:29:04.796014+0000","last_peered":"2023-08-10T10:29:04.796014+0000","last_clean":"2023-08-10T10:29:04.796014+0000","last_became_active":"2023-08-10T10:29:02.508669+0000","last_became_peered":"2023-08-10T10:29:02.508669+0000","last_unstale":"2023-08-10T10:29:04.796014+0000","last_undegraded":"2023-08-10T10:29:04.796014+0000","last_fullsized":"2023-08-10T10:29:04.796014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344680+0000","last_change":"2023-08-10T10:29:03.450335+0000","last_active":"2023-08-10T10:29:06.344680+0000","last_peered":"2023-08-10T10:29:06.344680+0000","last_clean":"2023-08-10T10:29:06.344680+0000","last_became_active":"2023-08-10T10:29:03.449118+0000","last_became_peered":"2023-08-10T10:29:03.449118+0000","last_unstale":"2023-08-10T10:29:06.344680+0000","last_undegraded":"2023-08-10T10:29:06.344680+0000","last_fullsized":"2023-08-10T10:29:06.344680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440904+0000","last_change":"2023-08-10T10:29:02.508190+0000","last_active":"2023-08-10T10:29:04.440904+0000","last_peered":"2023-08-10T10:29:04.440904+0000","last_clean":"2023-08-10T10:29:04.440904+0000","last_became_active":"2023-08-10T10:29:02.507882+0000","last_became_peered":"2023-08-10T10:29:02.507882+0000","last_unstale":"2023-08-10T10:29:04.440904+0000","last_undegraded":"2023-08-10T10:29:04.440904+0000","last_fullsized":"2023-08-10T10:29:04.440904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796210+0000","last_change":"2023-08-10T10:29:03.448316+0000","last_active":"2023-08-10T10:29:04.796210+0000","last_peered":"2023-08-10T10:29:04.796210+0000","last_clean":"2023-08-10T10:29:04.796210+0000","last_became_active":"2023-08-10T10:29:03.447711+0000","last_became_peered":"2023-08-10T10:29:03.447711+0000","last_unstale":"2023-08-10T10:29:04.796210+0000","last_undegraded":"2023-08-10T10:29:04.796210+0000","last_fullsized":"2023-08-10T10:29:04.796210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564253+0000","last_change":"2023-08-10T10:29:02.508683+0000","last_active":"2023-08-10T10:29:06.564253+0000","last_peered":"2023-08-10T10:29:06.564253+0000","last_clean":"2023-08-10T10:29:06.564253+0000","last_became_active":"2023-08-10T10:29:02.508399+0000","last_became_peered":"2023-08-10T10:29:02.508399+0000","last_unstale":"2023-08-10T10:29:06.564253+0000","last_undegraded":"2023-08-10T10:29:06.564253+0000","last_fullsized":"2023-08-10T10:29:06.564253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:45.110488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086773+0000","last_change":"2023-08-10T10:29:03.444878+0000","last_active":"2023-08-10T10:29:06.086773+0000","last_peered":"2023-08-10T10:29:06.086773+0000","last_clean":"2023-08-10T10:29:06.086773+0000","last_became_active":"2023-08-10T10:29:03.444560+0000","last_became_peered":"2023-08-10T10:29:03.444560+0000","last_unstale":"2023-08-10T10:29:06.086773+0000","last_undegraded":"2023-08-10T10:29:06.086773+0000","last_fullsized":"2023-08-10T10:29:06.086773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441325+0000","last_change":"2023-08-10T10:29:02.506132+0000","last_active":"2023-08-10T10:29:04.441325+0000","last_peered":"2023-08-10T10:29:04.441325+0000","last_clean":"2023-08-10T10:29:04.441325+0000","last_became_active":"2023-08-10T10:29:02.505862+0000","last_became_peered":"2023-08-10T10:29:02.505862+0000","last_unstale":"2023-08-10T10:29:04.441325+0000","last_undegraded":"2023-08-10T10:29:04.441325+0000","last_fullsized":"2023-08-10T10:29:04.441325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:53.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344467+0000","last_change":"2023-08-10T10:29:03.448717+0000","last_active":"2023-08-10T10:29:06.344467+0000","last_peered":"2023-08-10T10:29:06.344467+0000","last_clean":"2023-08-10T10:29:06.344467+0000","last_became_active":"2023-08-10T10:29:03.448231+0000","last_became_peered":"2023-08-10T10:29:03.448231+0000","last_unstale":"2023-08-10T10:29:06.344467+0000","last_undegraded":"2023-08-10T10:29:06.344467+0000","last_fullsized":"2023-08-10T10:29:06.344467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441232+0000","last_change":"2023-08-10T10:29:02.503467+0000","last_active":"2023-08-10T10:29:04.441232+0000","last_peered":"2023-08-10T10:29:04.441232+0000","last_clean":"2023-08-10T10:29:04.441232+0000","last_became_active":"2023-08-10T10:29:02.503095+0000","last_became_peered":"2023-08-10T10:29:02.503095+0000","last_unstale":"2023-08-10T10:29:04.441232+0000","last_undegraded":"2023-08-10T10:29:04.441232+0000","last_fullsized":"2023-08-10T10:29:04.441232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:52.156146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.443580+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.443304+0000","last_became_peered":"2023-08-10T10:29:03.443304+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441314+0000","last_change":"2023-08-10T10:29:02.508008+0000","last_active":"2023-08-10T10:29:04.441314+0000","last_peered":"2023-08-10T10:29:04.441314+0000","last_clean":"2023-08-10T10:29:04.441314+0000","last_became_active":"2023-08-10T10:29:02.507657+0000","last_became_peered":"2023-08-10T10:29:02.507657+0000","last_unstale":"2023-08-10T10:29:04.441314+0000","last_undegraded":"2023-08-10T10:29:04.441314+0000","last_fullsized":"2023-08-10T10:29:04.441314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:55.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564606+0000","last_change":"2023-08-10T10:29:03.440621+0000","last_active":"2023-08-10T10:29:06.564606+0000","last_peered":"2023-08-10T10:29:06.564606+0000","last_clean":"2023-08-10T10:29:06.564606+0000","last_became_active":"2023-08-10T10:29:03.440332+0000","last_became_peered":"2023-08-10T10:29:03.440332+0000","last_unstale":"2023-08-10T10:29:06.564606+0000","last_undegraded":"2023-08-10T10:29:06.564606+0000","last_fullsized":"2023-08-10T10:29:06.564606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344711+0000","last_change":"2023-08-10T10:29:02.509818+0000","last_active":"2023-08-10T10:29:06.344711+0000","last_peered":"2023-08-10T10:29:06.344711+0000","last_clean":"2023-08-10T10:29:06.344711+0000","last_became_active":"2023-08-10T10:29:02.509518+0000","last_became_peered":"2023-08-10T10:29:02.509518+0000","last_unstale":"2023-08-10T10:29:06.344711+0000","last_undegraded":"2023-08-10T10:29:06.344711+0000","last_fullsized":"2023-08-10T10:29:06.344711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796348+0000","last_change":"2023-08-10T10:29:03.447884+0000","last_active":"2023-08-10T10:29:04.796348+0000","last_peered":"2023-08-10T10:29:04.796348+0000","last_clean":"2023-08-10T10:29:04.796348+0000","last_became_active":"2023-08-10T10:29:03.447609+0000","last_became_peered":"2023-08-10T10:29:03.447609+0000","last_unstale":"2023-08-10T10:29:04.796348+0000","last_undegraded":"2023-08-10T10:29:04.796348+0000","last_fullsized":"2023-08-10T10:29:04.796348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086361+0000","last_change":"2023-08-10T10:29:02.508827+0000","last_active":"2023-08-10T10:29:06.086361+0000","last_peered":"2023-08-10T10:29:06.086361+0000","last_clean":"2023-08-10T10:29:06.086361+0000","last_became_active":"2023-08-10T10:29:02.508532+0000","last_became_peered":"2023-08-10T10:29:02.508532+0000","last_unstale":"2023-08-10T10:29:06.086361+0000","last_undegraded":"2023-08-10T10:29:06.086361+0000","last_fullsized":"2023-08-10T10:29:06.086361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436080+0000","last_change":"2023-08-10T10:29:03.442543+0000","last_active":"2023-08-10T10:29:04.436080+0000","last_peered":"2023-08-10T10:29:04.436080+0000","last_clean":"2023-08-10T10:29:04.436080+0000","last_became_active":"2023-08-10T10:29:03.439760+0000","last_became_peered":"2023-08-10T10:29:03.439760+0000","last_unstale":"2023-08-10T10:29:04.436080+0000","last_undegraded":"2023-08-10T10:29:04.436080+0000","last_fullsized":"2023-08-10T10:29:04.436080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564433+0000","last_change":"2023-08-10T10:29:02.511617+0000","last_active":"2023-08-10T10:29:06.564433+0000","last_peered":"2023-08-10T10:29:06.564433+0000","last_clean":"2023-08-10T10:29:06.564433+0000","last_became_active":"2023-08-10T10:29:02.511332+0000","last_became_peered":"2023-08-10T10:29:02.511332+0000","last_unstale":"2023-08-10T10:29:06.564433+0000","last_undegraded":"2023-08-10T10:29:06.564433+0000","last_fullsized":"2023-08-10T10:29:06.564433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:42.078663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435889+0000","last_change":"2023-08-10T10:29:03.438600+0000","last_active":"2023-08-10T10:29:04.435889+0000","last_peered":"2023-08-10T10:29:04.435889+0000","last_clean":"2023-08-10T10:29:04.435889+0000","last_became_active":"2023-08-10T10:29:03.438329+0000","last_became_peered":"2023-08-10T10:29:03.438329+0000","last_unstale":"2023-08-10T10:29:04.435889+0000","last_undegraded":"2023-08-10T10:29:04.435889+0000","last_fullsized":"2023-08-10T10:29:04.435889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435725+0000","last_change":"2023-08-10T10:29:02.501143+0000","last_active":"2023-08-10T10:29:04.435725+0000","last_peered":"2023-08-10T10:29:04.435725+0000","last_clean":"2023-08-10T10:29:04.435725+0000","last_became_active":"2023-08-10T10:29:02.500734+0000","last_became_peered":"2023-08-10T10:29:02.500734+0000","last_unstale":"2023-08-10T10:29:04.435725+0000","last_undegraded":"2023-08-10T10:29:04.435725+0000","last_fullsized":"2023-08-10T10:29:04.435725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435945+0000","last_change":"2023-08-10T10:29:03.441585+0000","last_active":"2023-08-10T10:29:04.435945+0000","last_peered":"2023-08-10T10:29:04.435945+0000","last_clean":"2023-08-10T10:29:04.435945+0000","last_became_active":"2023-08-10T10:29:03.441315+0000","last_became_peered":"2023-08-10T10:29:03.441315+0000","last_unstale":"2023-08-10T10:29:04.435945+0000","last_undegraded":"2023-08-10T10:29:04.435945+0000","last_fullsized":"2023-08-10T10:29:04.435945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086015+0000","last_change":"2023-08-10T10:29:02.509843+0000","last_active":"2023-08-10T10:29:06.086015+0000","last_peered":"2023-08-10T10:29:06.086015+0000","last_clean":"2023-08-10T10:29:06.086015+0000","last_became_active":"2023-08-10T10:29:02.509581+0000","last_became_peered":"2023-08-10T10:29:02.509581+0000","last_unstale":"2023-08-10T10:29:06.086015+0000","last_undegraded":"2023-08-10T10:29:06.086015+0000","last_fullsized":"2023-08-10T10:29:06.086015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454594+0000","last_change":"2023-08-10T10:29:03.447663+0000","last_active":"2023-08-10T10:29:06.454594+0000","last_peered":"2023-08-10T10:29:06.454594+0000","last_clean":"2023-08-10T10:29:06.454594+0000","last_became_active":"2023-08-10T10:29:03.447249+0000","last_became_peered":"2023-08-10T10:29:03.447249+0000","last_unstale":"2023-08-10T10:29:06.454594+0000","last_undegraded":"2023-08-10T10:29:06.454594+0000","last_fullsized":"2023-08-10T10:29:06.454594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.453942+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:06.453942+0000","last_peered":"2023-08-10T10:29:06.453942+0000","last_clean":"2023-08-10T10:29:06.453942+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:06.453942+0000","last_undegraded":"2023-08-10T10:29:06.453942+0000","last_fullsized":"2023-08-10T10:29:06.453942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:30.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344840+0000","last_change":"2023-08-10T10:29:02.509950+0000","last_active":"2023-08-10T10:29:06.344840+0000","last_peered":"2023-08-10T10:29:06.344840+0000","last_clean":"2023-08-10T10:29:06.344840+0000","last_became_active":"2023-08-10T10:29:02.509612+0000","last_became_peered":"2023-08-10T10:29:02.509612+0000","last_unstale":"2023-08-10T10:29:06.344840+0000","last_undegraded":"2023-08-10T10:29:06.344840+0000","last_fullsized":"2023-08-10T10:29:06.344840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454290+0000","last_change":"2023-08-10T10:29:03.448544+0000","last_active":"2023-08-10T10:29:06.454290+0000","last_peered":"2023-08-10T10:29:06.454290+0000","last_clean":"2023-08-10T10:29:06.454290+0000","last_became_active":"2023-08-10T10:29:03.448140+0000","last_became_peered":"2023-08-10T10:29:03.448140+0000","last_unstale":"2023-08-10T10:29:06.454290+0000","last_undegraded":"2023-08-10T10:29:06.454290+0000","last_fullsized":"2023-08-10T10:29:06.454290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344627+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:06.344627+0000","last_peered":"2023-08-10T10:29:06.344627+0000","last_clean":"2023-08-10T10:29:06.344627+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:06.344627+0000","last_undegraded":"2023-08-10T10:29:06.344627+0000","last_fullsized":"2023-08-10T10:29:06.344627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:39.055486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436302+0000","last_change":"2023-08-10T10:29:02.508916+0000","last_active":"2023-08-10T10:29:04.436302+0000","last_peered":"2023-08-10T10:29:04.436302+0000","last_clean":"2023-08-10T10:29:04.436302+0000","last_became_active":"2023-08-10T10:29:02.508630+0000","last_became_peered":"2023-08-10T10:29:02.508630+0000","last_unstale":"2023-08-10T10:29:04.436302+0000","last_undegraded":"2023-08-10T10:29:04.436302+0000","last_fullsized":"2023-08-10T10:29:04.436302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:28.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454399+0000","last_change":"2023-08-10T10:29:03.449910+0000","last_active":"2023-08-10T10:29:06.454399+0000","last_peered":"2023-08-10T10:29:06.454399+0000","last_clean":"2023-08-10T10:29:06.454399+0000","last_became_active":"2023-08-10T10:29:03.449231+0000","last_became_peered":"2023-08-10T10:29:03.449231+0000","last_unstale":"2023-08-10T10:29:06.454399+0000","last_undegraded":"2023-08-10T10:29:06.454399+0000","last_fullsized":"2023-08-10T10:29:06.454399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454065+0000","last_change":"2023-08-10T10:29:02.506926+0000","last_active":"2023-08-10T10:29:06.454065+0000","last_peered":"2023-08-10T10:29:06.454065+0000","last_clean":"2023-08-10T10:29:06.454065+0000","last_became_active":"2023-08-10T10:29:02.506687+0000","last_became_peered":"2023-08-10T10:29:02.506687+0000","last_unstale":"2023-08-10T10:29:06.454065+0000","last_undegraded":"2023-08-10T10:29:06.454065+0000","last_fullsized":"2023-08-10T10:29:06.454065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454532+0000","last_change":"2023-08-10T10:29:03.450582+0000","last_active":"2023-08-10T10:29:06.454532+0000","last_peered":"2023-08-10T10:29:06.454532+0000","last_clean":"2023-08-10T10:29:06.454532+0000","last_became_active":"2023-08-10T10:29:03.450087+0000","last_became_peered":"2023-08-10T10:29:03.450087+0000","last_unstale":"2023-08-10T10:29:06.454532+0000","last_undegraded":"2023-08-10T10:29:06.454532+0000","last_fullsized":"2023-08-10T10:29:06.454532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344340+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:06.344340+0000","last_peered":"2023-08-10T10:29:06.344340+0000","last_clean":"2023-08-10T10:29:06.344340+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:06.344340+0000","last_undegraded":"2023-08-10T10:29:06.344340+0000","last_fullsized":"2023-08-10T10:29:06.344340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:43.417388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440678+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:04.440678+0000","last_peered":"2023-08-10T10:29:04.440678+0000","last_clean":"2023-08-10T10:29:04.440678+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:04.440678+0000","last_undegraded":"2023-08-10T10:29:04.440678+0000","last_fullsized":"2023-08-10T10:29:04.440678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:15.475871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086186+0000","last_change":"2023-08-10T10:29:02.509636+0000","last_active":"2023-08-10T10:29:06.086186+0000","last_peered":"2023-08-10T10:29:06.086186+0000","last_clean":"2023-08-10T10:29:06.086186+0000","last_became_active":"2023-08-10T10:29:02.509357+0000","last_became_peered":"2023-08-10T10:29:02.509357+0000","last_unstale":"2023-08-10T10:29:06.086186+0000","last_undegraded":"2023-08-10T10:29:06.086186+0000","last_fullsized":"2023-08-10T10:29:06.086186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:10.904417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564564+0000","last_change":"2023-08-10T10:29:03.443731+0000","last_active":"2023-08-10T10:29:06.564564+0000","last_peered":"2023-08-10T10:29:06.564564+0000","last_clean":"2023-08-10T10:29:06.564564+0000","last_became_active":"2023-08-10T10:29:03.443369+0000","last_became_peered":"2023-08-10T10:29:03.443369+0000","last_unstale":"2023-08-10T10:29:06.564564+0000","last_undegraded":"2023-08-10T10:29:06.564564+0000","last_fullsized":"2023-08-10T10:29:06.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:14.287109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440834+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:04.440834+0000","last_peered":"2023-08-10T10:29:04.440834+0000","last_clean":"2023-08-10T10:29:04.440834+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:04.440834+0000","last_undegraded":"2023-08-10T10:29:04.440834+0000","last_fullsized":"2023-08-10T10:29:04.440834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796044+0000","last_change":"2023-08-10T10:29:02.508404+0000","last_active":"2023-08-10T10:29:04.796044+0000","last_peered":"2023-08-10T10:29:04.796044+0000","last_clean":"2023-08-10T10:29:04.796044+0000","last_became_active":"2023-08-10T10:29:02.508118+0000","last_became_peered":"2023-08-10T10:29:02.508118+0000","last_unstale":"2023-08-10T10:29:04.796044+0000","last_undegraded":"2023-08-10T10:29:04.796044+0000","last_fullsized":"2023-08-10T10:29:04.796044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:21.071137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796403+0000","last_change":"2023-08-10T10:29:03.449361+0000","last_active":"2023-08-10T10:29:04.796403+0000","last_peered":"2023-08-10T10:29:04.796403+0000","last_clean":"2023-08-10T10:29:04.796403+0000","last_became_active":"2023-08-10T10:29:03.448855+0000","last_became_peered":"2023-08-10T10:29:03.448855+0000","last_unstale":"2023-08-10T10:29:04.796403+0000","last_undegraded":"2023-08-10T10:29:04.796403+0000","last_fullsized":"2023-08-10T10:29:04.796403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441134+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:04.441134+0000","last_peered":"2023-08-10T10:29:04.441134+0000","last_clean":"2023-08-10T10:29:04.441134+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:04.441134+0000","last_undegraded":"2023-08-10T10:29:04.441134+0000","last_fullsized":"2023-08-10T10:29:04.441134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:24.224979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454493+0000","last_change":"2023-08-10T10:29:02.507620+0000","last_active":"2023-08-10T10:29:06.454493+0000","last_peered":"2023-08-10T10:29:06.454493+0000","last_clean":"2023-08-10T10:29:06.454493+0000","last_became_active":"2023-08-10T10:29:02.507334+0000","last_became_peered":"2023-08-10T10:29:02.507334+0000","last_unstale":"2023-08-10T10:29:06.454493+0000","last_undegraded":"2023-08-10T10:29:06.454493+0000","last_fullsized":"2023-08-10T10:29:06.454493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796133+0000","last_change":"2023-08-10T10:29:03.451179+0000","last_active":"2023-08-10T10:29:04.796133+0000","last_peered":"2023-08-10T10:29:04.796133+0000","last_clean":"2023-08-10T10:29:04.796133+0000","last_became_active":"2023-08-10T10:29:03.450918+0000","last_became_peered":"2023-08-10T10:29:03.450918+0000","last_unstale":"2023-08-10T10:29:04.796133+0000","last_undegraded":"2023-08-10T10:29:04.796133+0000","last_fullsized":"2023-08-10T10:29:04.796133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086651+0000","last_change":"2023-08-10T10:29:02.509567+0000","last_active":"2023-08-10T10:29:06.086651+0000","last_peered":"2023-08-10T10:29:06.086651+0000","last_clean":"2023-08-10T10:29:06.086651+0000","last_became_active":"2023-08-10T10:29:02.509227+0000","last_became_peered":"2023-08-10T10:29:02.509227+0000","last_unstale":"2023-08-10T10:29:06.086651+0000","last_undegraded":"2023-08-10T10:29:06.086651+0000","last_fullsized":"2023-08-10T10:29:06.086651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454598+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:06.454598+0000","last_peered":"2023-08-10T10:29:06.454598+0000","last_clean":"2023-08-10T10:29:06.454598+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:06.454598+0000","last_undegraded":"2023-08-10T10:29:06.454598+0000","last_fullsized":"2023-08-10T10:29:06.454598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.085979+0000","last_change":"2023-08-10T10:29:03.445049+0000","last_active":"2023-08-10T10:29:06.085979+0000","last_peered":"2023-08-10T10:29:06.085979+0000","last_clean":"2023-08-10T10:29:06.085979+0000","last_became_active":"2023-08-10T10:29:03.444724+0000","last_became_peered":"2023-08-10T10:29:03.444724+0000","last_unstale":"2023-08-10T10:29:06.085979+0000","last_undegraded":"2023-08-10T10:29:06.085979+0000","last_fullsized":"2023-08-10T10:29:06.085979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564247+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:06.564247+0000","last_peered":"2023-08-10T10:29:06.564247+0000","last_clean":"2023-08-10T10:29:06.564247+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:06.564247+0000","last_undegraded":"2023-08-10T10:29:06.564247+0000","last_fullsized":"2023-08-10T10:29:06.564247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:51.252030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.208517+0000","last_change":"2023-08-10T10:29:02.508685+0000","last_active":"2023-08-10T10:29:06.208517+0000","last_peered":"2023-08-10T10:29:06.208517+0000","last_clean":"2023-08-10T10:29:06.208517+0000","last_became_active":"2023-08-10T10:29:02.508376+0000","last_became_peered":"2023-08-10T10:29:02.508376+0000","last_unstale":"2023-08-10T10:29:06.208517+0000","last_undegraded":"2023-08-10T10:29:06.208517+0000","last_fullsized":"2023-08-10T10:29:06.208517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435479+0000","last_change":"2023-08-10T10:29:03.449122+0000","last_active":"2023-08-10T10:29:04.435479+0000","last_peered":"2023-08-10T10:29:04.435479+0000","last_clean":"2023-08-10T10:29:04.435479+0000","last_became_active":"2023-08-10T10:29:03.448040+0000","last_became_peered":"2023-08-10T10:29:03.448040+0000","last_unstale":"2023-08-10T10:29:04.435479+0000","last_undegraded":"2023-08-10T10:29:04.435479+0000","last_fullsized":"2023-08-10T10:29:04.435479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796191+0000","last_change":"2023-08-10T10:29:02.511445+0000","last_active":"2023-08-10T10:29:04.796191+0000","last_peered":"2023-08-10T10:29:04.796191+0000","last_clean":"2023-08-10T10:29:04.796191+0000","last_became_active":"2023-08-10T10:29:02.511184+0000","last_became_peered":"2023-08-10T10:29:02.511184+0000","last_unstale":"2023-08-10T10:29:04.796191+0000","last_undegraded":"2023-08-10T10:29:04.796191+0000","last_fullsized":"2023-08-10T10:29:04.796191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344717+0000","last_change":"2023-08-10T10:29:02.506009+0000","last_active":"2023-08-10T10:29:06.344717+0000","last_peered":"2023-08-10T10:29:06.344717+0000","last_clean":"2023-08-10T10:29:06.344717+0000","last_became_active":"2023-08-10T10:29:02.505751+0000","last_became_peered":"2023-08-10T10:29:02.505751+0000","last_unstale":"2023-08-10T10:29:06.344717+0000","last_undegraded":"2023-08-10T10:29:06.344717+0000","last_fullsized":"2023-08-10T10:29:06.344717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436211+0000","last_change":"2023-08-10T10:29:03.440207+0000","last_active":"2023-08-10T10:29:04.436211+0000","last_peered":"2023-08-10T10:29:04.436211+0000","last_clean":"2023-08-10T10:29:04.436211+0000","last_became_active":"2023-08-10T10:29:03.439702+0000","last_became_peered":"2023-08-10T10:29:03.439702+0000","last_unstale":"2023-08-10T10:29:04.436211+0000","last_undegraded":"2023-08-10T10:29:04.436211+0000","last_fullsized":"2023-08-10T10:29:04.436211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344916+0000","last_change":"2023-08-10T10:29:02.507533+0000","last_active":"2023-08-10T10:29:06.344916+0000","last_peered":"2023-08-10T10:29:06.344916+0000","last_clean":"2023-08-10T10:29:06.344916+0000","last_became_active":"2023-08-10T10:29:02.507215+0000","last_became_peered":"2023-08-10T10:29:02.507215+0000","last_unstale":"2023-08-10T10:29:06.344916+0000","last_undegraded":"2023-08-10T10:29:06.344916+0000","last_fullsized":"2023-08-10T10:29:06.344916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436223+0000","last_change":"2023-08-10T10:29:03.440169+0000","last_active":"2023-08-10T10:29:04.436223+0000","last_peered":"2023-08-10T10:29:04.436223+0000","last_clean":"2023-08-10T10:29:04.436223+0000","last_became_active":"2023-08-10T10:29:03.439746+0000","last_became_peered":"2023-08-10T10:29:03.439746+0000","last_unstale":"2023-08-10T10:29:04.436223+0000","last_undegraded":"2023-08-10T10:29:04.436223+0000","last_fullsized":"2023-08-10T10:29:04.436223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086444+0000","last_change":"2023-08-10T10:29:02.508038+0000","last_active":"2023-08-10T10:29:06.086444+0000","last_peered":"2023-08-10T10:29:06.086444+0000","last_clean":"2023-08-10T10:29:06.086444+0000","last_became_active":"2023-08-10T10:29:02.507705+0000","last_became_peered":"2023-08-10T10:29:02.507705+0000","last_unstale":"2023-08-10T10:29:06.086444+0000","last_undegraded":"2023-08-10T10:29:06.086444+0000","last_fullsized":"2023-08-10T10:29:06.086444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086412+0000","last_change":"2023-08-10T10:29:03.439576+0000","last_active":"2023-08-10T10:29:06.086412+0000","last_peered":"2023-08-10T10:29:06.086412+0000","last_clean":"2023-08-10T10:29:06.086412+0000","last_became_active":"2023-08-10T10:29:03.439303+0000","last_became_peered":"2023-08-10T10:29:03.439303+0000","last_unstale":"2023-08-10T10:29:06.086412+0000","last_undegraded":"2023-08-10T10:29:06.086412+0000","last_fullsized":"2023-08-10T10:29:06.086412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796395+0000","last_change":"2023-08-10T10:29:02.514204+0000","last_active":"2023-08-10T10:29:04.796395+0000","last_peered":"2023-08-10T10:29:04.796395+0000","last_clean":"2023-08-10T10:29:04.796395+0000","last_became_active":"2023-08-10T10:29:02.514038+0000","last_became_peered":"2023-08-10T10:29:02.514038+0000","last_unstale":"2023-08-10T10:29:04.796395+0000","last_undegraded":"2023-08-10T10:29:04.796395+0000","last_fullsized":"2023-08-10T10:29:04.796395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435320+0000","last_change":"2023-08-10T10:29:03.440843+0000","last_active":"2023-08-10T10:29:04.435320+0000","last_peered":"2023-08-10T10:29:04.435320+0000","last_clean":"2023-08-10T10:29:04.435320+0000","last_became_active":"2023-08-10T10:29:03.440587+0000","last_became_peered":"2023-08-10T10:29:03.440587+0000","last_unstale":"2023-08-10T10:29:04.435320+0000","last_undegraded":"2023-08-10T10:29:04.435320+0000","last_fullsized":"2023-08-10T10:29:04.435320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564382+0000","last_change":"2023-08-10T10:29:03.448796+0000","last_active":"2023-08-10T10:29:06.564382+0000","last_peered":"2023-08-10T10:29:06.564382+0000","last_clean":"2023-08-10T10:29:06.564382+0000","last_became_active":"2023-08-10T10:29:03.448489+0000","last_became_peered":"2023-08-10T10:29:03.448489+0000","last_unstale":"2023-08-10T10:29:06.564382+0000","last_undegraded":"2023-08-10T10:29:06.564382+0000","last_fullsized":"2023-08-10T10:29:06.564382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:54:59.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086033+0000","last_change":"2023-08-10T10:29:03.441287+0000","last_active":"2023-08-10T10:29:06.086033+0000","last_peered":"2023-08-10T10:29:06.086033+0000","last_clean":"2023-08-10T10:29:06.086033+0000","last_became_active":"2023-08-10T10:29:03.441023+0000","last_became_peered":"2023-08-10T10:29:03.441023+0000","last_unstale":"2023-08-10T10:29:06.086033+0000","last_undegraded":"2023-08-10T10:29:06.086033+0000","last_fullsized":"2023-08-10T10:29:06.086033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435948+0000","last_change":"2023-08-10T10:29:03.442345+0000","last_active":"2023-08-10T10:29:04.435948+0000","last_peered":"2023-08-10T10:29:04.435948+0000","last_clean":"2023-08-10T10:29:04.435948+0000","last_became_active":"2023-08-10T10:29:03.441657+0000","last_became_peered":"2023-08-10T10:29:03.441657+0000","last_unstale":"2023-08-10T10:29:04.435948+0000","last_undegraded":"2023-08-10T10:29:04.435948+0000","last_fullsized":"2023-08-10T10:29:04.435948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086339+0000","last_change":"2023-08-10T10:29:03.447084+0000","last_active":"2023-08-10T10:29:06.086339+0000","last_peered":"2023-08-10T10:29:06.086339+0000","last_clean":"2023-08-10T10:29:06.086339+0000","last_became_active":"2023-08-10T10:29:03.446803+0000","last_became_peered":"2023-08-10T10:29:03.446803+0000","last_unstale":"2023-08-10T10:29:06.086339+0000","last_undegraded":"2023-08-10T10:29:06.086339+0000","last_fullsized":"2023-08-10T10:29:06.086339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454356+0000","last_change":"2023-08-10T10:29:03.449287+0000","last_active":"2023-08-10T10:29:06.454356+0000","last_peered":"2023-08-10T10:29:06.454356+0000","last_clean":"2023-08-10T10:29:06.454356+0000","last_became_active":"2023-08-10T10:29:03.448995+0000","last_became_peered":"2023-08-10T10:29:03.448995+0000","last_unstale":"2023-08-10T10:29:06.454356+0000","last_undegraded":"2023-08-10T10:29:06.454356+0000","last_fullsized":"2023-08-10T10:29:06.454356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:12.566 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:29:12.567 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-10T10:29:12.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-10T10:29:12.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-10T10:29:12.568 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-10T10:29:12.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.719+0000 7fad82752700 1 Processor -- start 2023-08-10T10:29:12.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.719+0000 7fad82752700 1 -- start start 2023-08-10T10:29:12.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad82752700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad82752700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c0c52c0 0x7fad7c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad82752700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0cc780 con 0x7fad7c15b050 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad82752700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0ccd40 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad82752700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0ce1d0 con 0x7fad7c0c52c0 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59950/0 (socket says 172.21.15.161:59950) 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 -- 172.21.15.161:0/4291251278 learned_addr learned my addr 172.21.15.161:0/4291251278 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:12.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad80cef700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c0c52c0 0x7fad7c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 -- 172.21.15.161:0/4291251278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c0c52c0 msgr2=0x7fad7c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c0c52c0 0x7fad7c0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 -- 172.21.15.161:0/4291251278 >> v1:172.21.15.175:6789/0 conn(0x7fad7c15b050 legacy=0x7fad7c0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 -- 172.21.15.161:0/4291251278 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0cca60 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7b7fe700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad700098f0 tx=0x7fad70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea4a1257a1029cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7affd700 1 -- 172.21.15.161:0/4291251278 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011830 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7affd700 1 -- 172.21.15.161:0/4291251278 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70011990 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.720+0000 7fad7affd700 1 -- 172.21.15.161:0/4291251278 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011d20 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 -- 172.21.15.161:0/4291251278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 msgr2=0x7fad7c0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad700098f0 tx=0x7fad70009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 -- 172.21.15.161:0/4291251278 shutdown_connections 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c0c52c0 0x7fad7c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 --2- 172.21.15.161:0/4291251278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c0cdc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 -- 172.21.15.161:0/4291251278 >> 172.21.15.161:0/4291251278 conn(0x7fad7c09a150 msgr2=0x7fad7c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:12.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 -- 172.21.15.161:0/4291251278 shutdown_connections 2023-08-10T10:29:12.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.721+0000 7fad82752700 1 -- 172.21.15.161:0/4291251278 wait complete. 2023-08-10T10:29:12.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.722+0000 7fad82752700 1 Processor -- start 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.722+0000 7fad82752700 1 -- start start 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c0c52c0 0x7fad7c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c15b050 0x7fad7c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c158160 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c14deb0 con 0x7fad7c0c52c0 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad82752700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1583b0 con 0x7fad7c15b050 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59956/0 (socket says 172.21.15.161:59956) 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 -- 172.21.15.161:0/3244024905 learned_addr learned my addr 172.21.15.161:0/3244024905 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7bfff700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c0c52c0 0x7fad7c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad80cef700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c15b050 0x7fad7c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 -- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c15b050 msgr2=0x7fad7c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c15b050 0x7fad7c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 -- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c0c52c0 msgr2=0x7fad7c14d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c0c52c0 0x7fad7c14d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.723+0000 7fad7b7fe700 1 -- 172.21.15.161:0/3244024905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70009550 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad7b7fe700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70004400 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7001f070 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c158690 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad700038e0 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.724+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c158c50 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.725+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c0744e0 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.725+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad70021030 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.725+0000 7fad78ff9700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 0x7fad6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.726+0000 7fad7bfff700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 0x7fad6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.726+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad7008a860 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.726+0000 7fad7bfff700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 0x7fad6806d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000fb0 tx=0x7fad6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:12.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.730+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad70055920 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.973+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fad7c1e57a0 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.976+0000 7fad78ff9700 1 -- 172.21.15.161:0/3244024905 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7fad70058f40 con 0x7fad7c0cd7e0 2023-08-10T10:29:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 msgr2=0x7fad6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 0x7fad6806d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000fb0 tx=0x7fad6c009040 comp rx=0 tx=0).stop 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 msgr2=0x7fad7c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad70004750 comp rx=0 tx=0).stop 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 shutdown_connections 2023-08-10T10:29:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fad6806ace0 0x7fad6806d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad7c15b050 0x7fad7c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c0c52c0 0x7fad7c14d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 --2- 172.21.15.161:0/3244024905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c0cd7e0 0x7fad7c14ead0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 >> 172.21.15.161:0/3244024905 conn(0x7fad7c09a150 msgr2=0x7fad7c0c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 shutdown_connections 2023-08-10T10:29:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:12.978+0000 7fad82752700 1 -- 172.21.15.161:0/3244024905 wait complete. 2023-08-10T10:29:12.991 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":4243192540},{"type":"v1","addr":"172.21.15.161:6833","nonce":4243192540}]},"active_addr":"172.21.15.161:6833/4243192540","active_change":"2023-08-10T10:28:44.178458+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1935818220}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2396562151}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2885984874}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":705014541}]}]} 2023-08-10T10:29:12.996 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-10T10:29:12.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-10T10:29:12.996 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:13.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.115+0000 7f1c12206700 1 Processor -- start 2023-08-10T10:29:13.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.115+0000 7f1c12206700 1 -- start start 2023-08-10T10:29:13.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.115+0000 7f1c12206700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.115+0000 7f1c12206700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c0c52c0 0x7f1c0c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.115+0000 7f1c12206700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0cc780 con 0x7f1c0c15b050 2023-08-10T10:29:13.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c12206700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0ccd40 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c12206700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0ce1d0 con 0x7f1c0c0c52c0 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59964/0 (socket says 172.21.15.161:59964) 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 -- 172.21.15.161:0/3557733769 learned_addr learned my addr 172.21.15.161:0/3557733769 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0b7fe700 1 --1- 172.21.15.161:0/3557733769 >> v1:172.21.15.161:6789/0 conn(0x7f1c0c15b050 0x7f1c0c0d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36968/0 (socket says 172.21.15.161:36968) 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 -- 172.21.15.161:0/3557733769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c0c52c0 msgr2=0x7f1c0c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 --2- 172.21.15.161:0/3557733769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c0c52c0 0x7f1c0c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 -- 172.21.15.161:0/3557733769 >> v1:172.21.15.161:6789/0 conn(0x7f1c0c15b050 legacy=0x7f1c0c0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 -- 172.21.15.161:0/3557733769 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0cca60 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0a7fc700 1 -- 172.21.15.161:0/3557733769 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637049522 0 0) 0x7f1c0c0cc780 con 0x7f1c0c15b050 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0affd700 1 --2- 172.21.15.161:0/3557733769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8844341eca6503a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0a7fc700 1 -- 172.21.15.161:0/3557733769 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000b8a0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0a7fc700 1 -- 172.21.15.161:0/3557733769 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000ba00 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.116+0000 7f1c0a7fc700 1 -- 172.21.15.161:0/3557733769 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000bd90 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 -- 172.21.15.161:0/3557733769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 msgr2=0x7f1c0c0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 --2- 172.21.15.161:0/3557733769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 -- 172.21.15.161:0/3557733769 shutdown_connections 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 --2- 172.21.15.161:0/3557733769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c0c52c0 0x7f1c0c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 --2- 172.21.15.161:0/3557733769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0cdc90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 -- 172.21.15.161:0/3557733769 >> 172.21.15.161:0/3557733769 conn(0x7f1c0c09a150 msgr2=0x7f1c0c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 -- 172.21.15.161:0/3557733769 shutdown_connections 2023-08-10T10:29:13.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.117+0000 7f1c12206700 1 -- 172.21.15.161:0/3557733769 wait complete. 2023-08-10T10:29:13.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.118+0000 7f1c12206700 1 Processor -- start 2023-08-10T10:29:13.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.118+0000 7f1c12206700 1 -- start start 2023-08-10T10:29:13.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 0x7f1c0c1f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 0x7f1c0c1f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0cb290 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c98d0 con 0x7f1c0c0c52c0 2023-08-10T10:29:13.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c12206700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c9440 con 0x7f1c0c15b050 2023-08-10T10:29:13.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59970/0 (socket says 172.21.15.161:59970) 2023-08-10T10:29:13.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 -- 172.21.15.161:0/3693048602 learned_addr learned my addr 172.21.15.161:0/3693048602 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0bfff700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 0x7f1c0c1f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0b7fe700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 0x7f1c0c1f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 -- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 msgr2=0x7f1c0c1f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 0x7f1c0c1f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 -- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 msgr2=0x7f1c0c1f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 0x7f1c0c1f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 -- 172.21.15.161:0/3693048602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00009550 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0bfff700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 0x7f1c0c1f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:13.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0b7fe700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 0x7f1c0c1f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:13.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1c0affd700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c071940 tx=0x7f1c00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004480 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.119+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0001f070 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.120+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c0c8590 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.120+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000038c0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.120+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0c8b10 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.121+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c0cdff0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.121+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c00021030 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.121+0000 7f1bf3fff700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 0x7f1bf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.121+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c0008a990 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.121+0000 7f1c0b7fe700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 0x7f1bf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.122+0000 7f1c0b7fe700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 0x7f1bf806d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c1f5350 tx=0x7f1bfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.126+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1c00055ad0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.314+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c0c0c95b0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.316+0000 7f1bf3fff700 1 -- 172.21.15.161:0/3693048602 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f1c000590f0 con 0x7f1c0c0cd7e0 2023-08-10T10:29:13.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:13.317 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 msgr2=0x7f1bf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 0x7f1bf806d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c1f5350 tx=0x7f1bfc009040 comp rx=0 tx=0).stop 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 msgr2=0x7f1c0c0c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c071940 tx=0x7f1c00004750 comp rx=0 tx=0).stop 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 shutdown_connections 2023-08-10T10:29:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1bf806ace0 0x7f1bf806d1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c0c15b050 0x7f1c0c1f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c0c0c52c0 0x7f1c0c1f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 --2- 172.21.15.161:0/3693048602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c0c0cd7e0 0x7f1c0c0c8050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 >> 172.21.15.161:0/3693048602 conn(0x7f1c0c09a150 msgr2=0x7f1c0c1e5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 shutdown_connections 2023-08-10T10:29:13.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.318+0000 7f1c12206700 1 -- 172.21.15.161:0/3693048602 wait complete. 2023-08-10T10:29:13.331 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-10T10:29:13.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:13.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.452+0000 7f09e400b700 1 Processor -- start 2023-08-10T10:29:13.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.452+0000 7f09e400b700 1 -- start start 2023-08-10T10:29:13.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e400b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc0d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e400b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09dc0d0450 0x7f09dc0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e400b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc0d1680 con 0x7f09dc15d540 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e400b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0d1960 con 0x7f09dc0d0450 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e400b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0d1c40 con 0x7f09dc0cf960 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09dc0d0450 0x7f09dc0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09dc0d0450 0x7f09dc0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59980/0 (socket says 172.21.15.161:59980) 2023-08-10T10:29:13.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 -- 172.21.15.161:0/1635259849 learned_addr learned my addr 172.21.15.161:0/1635259849 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e1da7700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc0d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 -- 172.21.15.161:0/1635259849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 msgr2=0x7f09dc0d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc0d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 -- 172.21.15.161:0/1635259849 >> v1:172.21.15.175:6789/0 conn(0x7f09dc15d540 legacy=0x7f09dc0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 -- 172.21.15.161:0/1635259849 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0d1f20 con 0x7f09dc0d0450 2023-08-10T10:29:13.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e25a8700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0d0450 0x7f09dc0b2f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8747eac2e8251e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e0da5700 1 -- 172.21.15.161:0/1635259849 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400e070 con 0x7f09dc0d0450 2023-08-10T10:29:13.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e0da5700 1 -- 172.21.15.161:0/1635259849 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400b910 con 0x7f09dc0d0450 2023-08-10T10:29:13.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.453+0000 7f09e0da5700 1 -- 172.21.15.161:0/1635259849 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400bcc0 con 0x7f09dc0d0450 2023-08-10T10:29:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 -- 172.21.15.161:0/1635259849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0d0450 msgr2=0x7f09dc0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0d0450 0x7f09dc0b2f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 -- 172.21.15.161:0/1635259849 shutdown_connections 2023-08-10T10:29:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0d0450 0x7f09dc0b2f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 --2- 172.21.15.161:0/1635259849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc0d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 -- 172.21.15.161:0/1635259849 >> 172.21.15.161:0/1635259849 conn(0x7f09dc0d3000 msgr2=0x7f09dc0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 -- 172.21.15.161:0/1635259849 shutdown_connections 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.454+0000 7f09e400b700 1 -- 172.21.15.161:0/1635259849 wait complete. 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.455+0000 7f09e400b700 1 Processor -- start 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.455+0000 7f09e400b700 1 -- start start 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09dc0d0450 0x7f09dc15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15ee30 con 0x7f09dc15d540 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0b6d10 con 0x7f09dc0d0450 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e400b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0b6ff0 con 0x7f09dc0cf960 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59986/0 (socket says 172.21.15.161:59986) 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 -- 172.21.15.161:0/1068956962 learned_addr learned my addr 172.21.15.161:0/1068956962 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e1da7700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e15a6700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09dc0d0450 0x7f09dc15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 -- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 msgr2=0x7f09dc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 -- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09dc0d0450 msgr2=0x7f09dc15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09dc0d0450 0x7f09dc15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 -- 172.21.15.161:0/1068956962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009b30 con 0x7f09dc15d540 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.456+0000 7f09e25a8700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f09dc08bda0 tx=0x7f09d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.457+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4004960 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.457+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d40099b0 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.457+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d401c680 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.457+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc0b72d0 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.457+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc0cbdb0 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.458+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc0b7790 con 0x7f09dc15d540 2023-08-10T10:29:13.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.458+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09d401c7e0 con 0x7f09dc15d540 2023-08-10T10:29:13.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.458+0000 7f09d27fc700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 0x7f09c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.459+0000 7f09e1da7700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 0x7f09c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.459+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09d408b1b0 con 0x7f09dc15d540 2023-08-10T10:29:13.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.459+0000 7f09e1da7700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 0x7f09c006d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0cd430 tx=0x7f09d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.463+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f09d40562f0 con 0x7f09dc15d540 2023-08-10T10:29:13.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.653+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09dc0744e0 con 0x7f09dc15d540 2023-08-10T10:29:13.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.654+0000 7f09d27fc700 1 -- 172.21.15.161:0/1068956962 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f09d4059910 con 0x7f09dc15d540 2023-08-10T10:29:13.655 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:13.656 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:13.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 msgr2=0x7f09c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 0x7f09c006d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0cd430 tx=0x7f09d8008040 comp rx=0 tx=0).stop 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 msgr2=0x7f09dc0cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f09dc08bda0 tx=0x7f09d4004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 shutdown_connections 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f09c006ace0 0x7f09c006d1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc15d540 0x7f09dc0cb870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09dc0cf960 0x7f09dc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 --2- 172.21.15.161:0/1068956962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09dc0d0450 0x7f09dc15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 >> 172.21.15.161:0/1068956962 conn(0x7f09dc0d3000 msgr2=0x7f09dc073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 shutdown_connections 2023-08-10T10:29:13.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.656+0000 7f09e400b700 1 -- 172.21.15.161:0/1068956962 wait complete. 2023-08-10T10:29:13.670 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-10T10:29:13.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-10T10:29:13.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-10T10:29:13.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-10T10:29:13.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-10T10:29:13.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-10T10:29:13.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-10T10:29:13.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-10T10:29:13.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.872+0000 7f0834893700 1 Processor -- start 2023-08-10T10:29:13.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.872+0000 7f0834893700 1 -- start start 2023-08-10T10:29:13.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.873+0000 7f0834893700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f083006d050 0x7f083016e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.873+0000 7f0834893700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08300cb000 0x7f083016afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.873+0000 7f0834893700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083016e9b0 con 0x7f08300ce010 2023-08-10T10:29:13.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f0834893700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08300c9aa0 con 0x7f083006d050 2023-08-10T10:29:13.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f0834893700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083016b4e0 con 0x7f08300cb000 2023-08-10T10:29:13.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f082e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f083006d050 0x7f083016e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f082e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f083006d050 0x7f083016e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58794/0 (socket says 172.21.15.161:58794) 2023-08-10T10:29:13.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f082e59c700 1 -- 172.21.15.161:0/1541479937 learned_addr learned my addr 172.21.15.161:0/1541479937 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.874+0000 7f082dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08300cb000 0x7f083016afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.875+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530730452 0 0) 0x7f0820001110 con 0x7f08300ce010 2023-08-10T10:29:13.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.875+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08180035b0 con 0x7f08300ce010 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488283606 0 0) 0x7f08180035b0 con 0x7f08300ce010 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08300cb000 msgr2=0x7f083016afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08300cb000 0x7f083016afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 >> v2:172.21.15.175:3300/0 conn(0x7f083006d050 msgr2=0x7f083016e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 --2- 172.21.15.161:0/1541479937 >> v2:172.21.15.175:3300/0 conn(0x7f083006d050 0x7f083016e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300c9290 con 0x7f08300ce010 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f0820001800 con 0x7f08300ce010 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 >> v1:172.21.15.161:6789/0 conn(0x7f08300ce010 legacy=0x7f083006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0818003a00 0x7f0818003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08180043f0 0x7f08180048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0818004ff0 0x7f081800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c9aa0 con 0x7f08180043f0 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083016b4e0 con 0x7f0818004ff0 2023-08-10T10:29:13.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081800bf80 con 0x7f0818003a00 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0818004ff0 0x7f081800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 -- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0818003a00 msgr2=0x7f0818003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0818003a00 0x7f0818003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 -- 172.21.15.161:0/1541479937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08180043f0 msgr2=0x7f08180048d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08180043f0 0x7f08180048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.876+0000 7f082ed9d700 1 -- 172.21.15.161:0/1541479937 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300c9290 con 0x7f0818004ff0 2023-08-10T10:29:13.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f082ed9d700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0818004ff0 0x7f081800ba10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f082000c290 tx=0x7f0818005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2827fd3014b380 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000cd90 con 0x7f0818004ff0 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820012420 con 0x7f0818004ff0 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f082d59a700 1 -- 172.21.15.161:0/1541479937 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200127d0 con 0x7f0818004ff0 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f0834893700 1 -- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0818004ff0 msgr2=0x7f081800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f0834893700 1 --2- 172.21.15.161:0/1541479937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0818004ff0 0x7f081800ba10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f082000c290 tx=0x7f0818005880 comp rx=0 tx=0).stop 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f082ed9d700 1 -- 172.21.15.161:0/1541479937 reap_dead start 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f0834893700 1 -- 172.21.15.161:0/1541479937 shutdown_connections 2023-08-10T10:29:13.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f0834893700 1 -- 172.21.15.161:0/1541479937 >> 172.21.15.161:0/1541479937 conn(0x7f08300cec40 msgr2=0x7f08300cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f6175fb6700 1 Processor -- start 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.877+0000 7f6175fb6700 1 -- start start 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f6175fb6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700ce720 0x7f617016e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f6175fb6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61700cb000 0x7f617016afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f6175fb6700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617016e9b0 con 0x7f617006d050 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f6175fb6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700c9aa0 con 0x7f61700cb000 2023-08-10T10:29:13.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f6175fb6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617016b4e0 con 0x7f61700ce720 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f616f7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f617006d050 0x7f61700ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37006/0 (socket says 172.21.15.161:37006) 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f616f7fe700 1 -- 172.21.15.161:0/875867622 learned_addr learned my addr 172.21.15.161:0/875867622 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.878+0000 7f616effd700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700ce720 0x7f617016e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.879+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021657932 0 0) 0x7f6164001110 con 0x7f617006d050 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6158003a00 con 0x7f617006d050 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945292573 0 0) 0x7f6158003a00 con 0x7f617006d050 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700ce720 msgr2=0x7f617016e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700ce720 0x7f617016e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 >> v2:172.21.15.161:3300/0 conn(0x7f61700cb000 msgr2=0x7f617016afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 --2- 172.21.15.161:0/875867622 >> v2:172.21.15.161:3300/0 conn(0x7f61700cb000 0x7f617016afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700c9290 con 0x7f617006d050 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f6164001800 con 0x7f617006d050 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 >> v1:172.21.15.161:6789/0 conn(0x7f617006d050 legacy=0x7f61700ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61580034b0 0x7f61580046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158004dc0 0x7f6158005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6158009e50 0x7f615800c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61700c9aa0 con 0x7f6158009e50 2023-08-10T10:29:13.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617016b4e0 con 0x7f6158004dc0 2023-08-10T10:29:13.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.880+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615800c9a0 con 0x7f61580034b0 2023-08-10T10:29:13.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61580034b0 0x7f61580046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f0834893700 1 -- 172.21.15.161:0/1541479937 shutdown_connections 2023-08-10T10:29:13.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 -- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158004dc0 msgr2=0x7f6158005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158004dc0 0x7f6158005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 -- 172.21.15.161:0/875867622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6158009e50 msgr2=0x7f615800c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6158009e50 0x7f615800c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 -- 172.21.15.161:0/875867622 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158003a00 con 0x7f61580034b0 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616f7fe700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61580034b0 0x7f61580046e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6164007fd0 tx=0x7f6158005cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc975a0236d2befc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400cde0 con 0x7f61580034b0 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164005960 con 0x7f61580034b0 2023-08-10T10:29:13.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.881+0000 7f616e7fc700 1 -- 172.21.15.161:0/875867622 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164005d10 con 0x7f61580034b0 2023-08-10T10:29:13.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f0834893700 1 -- 172.21.15.161:0/1541479937 wait complete. 2023-08-10T10:29:13.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f6175fb6700 1 -- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61580034b0 msgr2=0x7f61580046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f6175fb6700 1 --2- 172.21.15.161:0/875867622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61580034b0 0x7f61580046e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6164007fd0 tx=0x7f6158005cd0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.884+0000 7f0834893700 1 Processor -- start 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.884+0000 7f0834893700 1 -- start start 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0830163740 0x7f08300c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 0x7f0830088330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0830163b20 0x7f0830088870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c6720 con 0x7f08300c7970 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c6fc0 con 0x7f0830163740 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f0834893700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c7ee0 con 0x7f0830163b20 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 0x7f0830088330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 0x7f0830088330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60012/0 (socket says 172.21.15.161:60012) 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 -- 172.21.15.161:0/402113209 learned_addr learned my addr 172.21.15.161:0/402113209 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082e59c700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0830163740 0x7f08300c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082ed9d700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0830163b20 0x7f0830088870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 -- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0830163b20 msgr2=0x7f0830088870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0830163b20 0x7f0830088870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 -- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0830163740 msgr2=0x7f08300c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0830163740 0x7f08300c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.885+0000 7f082dd9b700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300c6970 con 0x7f08300c7970 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f082dd9b700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 0x7f0830088330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0830072110 tx=0x7f082400e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400c070 con 0x7f08300c7970 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824013610 con 0x7f08300c7970 2023-08-10T10:29:13.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08240139a0 con 0x7f08300c7970 2023-08-10T10:29:13.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08300c6c50 con 0x7f08300c7970 2023-08-10T10:29:13.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.886+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0830088db0 con 0x7f08300c7970 2023-08-10T10:29:13.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.887+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08300c94e0 con 0x7f08300c7970 2023-08-10T10:29:13.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.888+0000 7f84c2a2c700 1 Processor -- start 2023-08-10T10:29:13.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.888+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0824013b00 con 0x7f08300c7970 2023-08-10T10:29:13.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f081effd700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f081006ace0 0x7f081006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7fa0e1a75700 1 Processor -- start 2023-08-10T10:29:13.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0824089570 con 0x7f08300c7970 2023-08-10T10:29:13.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f081effd700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] conn(0x7f0810073520 0x7f0810075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0810075ff0 con 0x7f0810073520 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08240899c0 con 0x7f08300c7970 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f082e59c700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f081006ace0 0x7f081006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.888+0000 7f84c2a2c700 1 -- start start 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f84c2a2c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84bc154620 0x7f84bc0717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f84c2a2c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc15b290 con 0x7f84bc071d10 2023-08-10T10:29:13.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f84c2a2c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc15b570 con 0x7f84bc06e650 2023-08-10T10:29:13.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f84c2a2c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0c5890 con 0x7f84bc154620 2023-08-10T10:29:13.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7f082e59c700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f081006ace0 0x7f081006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0828007270 tx=0x7f082800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84bb7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f84bc071d10 0x7f84bc06df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37028/0 (socket says 172.21.15.161:37028) 2023-08-10T10:29:13.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84bb7fe700 1 -- 172.21.15.161:0/610014954 learned_addr learned my addr 172.21.15.161:0/610014954 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216558888 0 0) 0x7f84bc15b290 con 0x7f84bc071d10 2023-08-10T10:29:13.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a40035b0 con 0x7f84bc071d10 2023-08-10T10:29:13.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.889+0000 7fa0e1a75700 1 -- start start 2023-08-10T10:29:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0e1a75700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0ce420 0x7fa0dc13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0e1a75700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc06b9e0 con 0x7fa0dc0c9a50 2023-08-10T10:29:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0e1a75700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc13f580 con 0x7fa0dc13f020 2023-08-10T10:29:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0e1a75700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06c010 con 0x7fa0dc0ce420 2023-08-10T10:29:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225545622 0 0) 0x7f84a40035b0 con 0x7f84bc071d10 2023-08-10T10:29:13.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 >> v2:172.21.15.175:3300/0 conn(0x7f84bc154620 msgr2=0x7f84bc0717d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 --2- 172.21.15.161:0/610014954 >> v2:172.21.15.175:3300/0 conn(0x7f84bc154620 0x7f84bc0717d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0dbfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa0dc0c9a50 0x7fa0dc156410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37034/0 (socket says 172.21.15.161:37034) 2023-08-10T10:29:13.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0dbfff700 1 -- 172.21.15.161:0/626646977 learned_addr learned my addr 172.21.15.161:0/626646977 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7fa0db7fe700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0ce420 0x7fa0dc13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 >> v1:172.21.15.175:6789/0 conn(0x7f84bc06e650 legacy=0x7f84bc15a5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc070cf0 con 0x7f84bc071d10 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f84b0001670 con 0x7f84bc071d10 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 >> v1:172.21.15.161:6789/0 conn(0x7f84bc071d10 legacy=0x7f84bc06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84a4003a00 0x7f84a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84a4004850 0x7f84a4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84a4005410 0x7f84a400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c5890 con 0x7f84a4003a00 2023-08-10T10:29:13.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400e4c0 con 0x7f84a4005410 2023-08-10T10:29:13.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.890+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400e680 con 0x7f84a4004850 2023-08-10T10:29:13.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f616ffff700 1 -- 172.21.15.161:0/875867622 reap_dead start 2023-08-10T10:29:13.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f6175fb6700 1 -- 172.21.15.161:0/875867622 shutdown_connections 2023-08-10T10:29:13.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.883+0000 7f6175fb6700 1 -- 172.21.15.161:0/875867622 >> 172.21.15.161:0/875867622 conn(0x7f61700cec40 msgr2=0x7f61700cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f6175fb6700 1 -- 172.21.15.161:0/875867622 shutdown_connections 2023-08-10T10:29:13.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355422335 0 0) 0x7fa0dc13f580 con 0x7fa0dc13f020 2023-08-10T10:29:13.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c40035b0 con 0x7fa0dc13f020 2023-08-10T10:29:13.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84a4004850 0x7f84a4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185792536 0 0) 0x7fa0dc06b9e0 con 0x7fa0dc0c9a50 2023-08-10T10:29:13.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0dc13f580 con 0x7fa0dc0c9a50 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844032858 0 0) 0x7fa0c40035b0 con 0x7fa0dc13f020 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0ce420 msgr2=0x7fa0dc13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0ce420 0x7fa0dc13eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 >> v1:172.21.15.161:6789/0 conn(0x7fa0dc0c9a50 legacy=0x7fa0dc156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc13f860 con 0x7fa0dc13f020 2023-08-10T10:29:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fa0cc0016b0 con 0x7fa0dc13f020 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 -- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84a4005410 msgr2=0x7f84a400dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84a4005410 0x7f84a400dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 -- 172.21.15.161:0/610014954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84a4003a00 msgr2=0x7f84a4003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84a4003a00 0x7f84a4003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 -- 172.21.15.161:0/610014954 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40035b0 con 0x7f84a4004850 2023-08-10T10:29:13.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84a4004850 0x7f84a4004cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84bc070c00 tx=0x7f84a4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a8b86263200cde server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000cdd0 con 0x7f84a4004850 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0005960 con 0x7f84a4004850 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7f84baffd700 1 -- 172.21.15.161:0/610014954 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0005cf0 con 0x7f84a4004850 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7f84c2a2c700 1 -- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84a4004850 msgr2=0x7f84a4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7f84c2a2c700 1 --2- 172.21.15.161:0/610014954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84a4004850 0x7f84a4004cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84bc070c00 tx=0x7f84a4005880 comp rx=0 tx=0).stop 2023-08-10T10:29:13.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 >> v1:172.21.15.175:6789/0 conn(0x7fa0dc13f020 legacy=0x7fa0dc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c4003b90 0x7fa0c4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0c4004850 0x7fa0c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c4005210 0x7fa0c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06c010 con 0x7fa0c4004850 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c400c0e0 con 0x7fa0c4003b90 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c400c220 con 0x7fa0c4005210 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0dbfff700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c4005210 0x7fa0c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.891+0000 7fa0daffd700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0c4004850 0x7fa0c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 -- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c4005210 msgr2=0x7fa0c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c4005210 0x7fa0c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 -- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c4003b90 msgr2=0x7fa0c4003f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c4003b90 0x7fa0c4003f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 -- 172.21.15.161:0/626646977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc13f860 con 0x7fa0c4004850 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0dbfff700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c4005210 0x7fa0c400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0daffd700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0c4004850 0x7fa0c4004cd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c270 tx=0x7fa0c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca951376d810e5b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007bd0 con 0x7fa0c4004850 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00cd90 con 0x7fa0c4004850 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.892+0000 7fa0da7fc700 1 -- 172.21.15.161:0/626646977 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc012640 con 0x7fa0c4004850 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f84c0fc9700 1 -- 172.21.15.161:0/610014954 reap_dead start 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f84c2a2c700 1 -- 172.21.15.161:0/610014954 shutdown_connections 2023-08-10T10:29:13.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f84c2a2c700 1 -- 172.21.15.161:0/610014954 >> 172.21.15.161:0/610014954 conn(0x7f84bc0cfd70 msgr2=0x7f84bc0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f742bd64700 1 Processor -- start 2023-08-10T10:29:13.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7fa0e1a75700 1 -- 172.21.15.161:0/626646977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0c4004850 msgr2=0x7fa0c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7fa0e1a75700 1 --2- 172.21.15.161:0/626646977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0c4004850 0x7fa0c4004cd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c270 tx=0x7fa0c4005880 comp rx=0 tx=0).stop 2023-08-10T10:29:13.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f742bd64700 1 -- start start 2023-08-10T10:29:13.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f84c2a2c700 1 -- 172.21.15.161:0/610014954 shutdown_connections 2023-08-10T10:29:13.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.893+0000 7f84c2a2c700 1 -- 172.21.15.161:0/610014954 wait complete. 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f742bd64700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f742415aed0 0x7f742415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f742bd64700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f74240c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f742bd64700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742415c340 con 0x7f74240b0a70 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f742bd64700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74240ca570 con 0x7f742415aed0 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f742bd64700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240b4890 con 0x7f74240700a0 2023-08-10T10:29:13.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f7429b00700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f742415aed0 0x7f742415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f7429b00700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f742415aed0 0x7f742415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60038/0 (socket says 172.21.15.161:60038) 2023-08-10T10:29:13.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 -- 172.21.15.161:0/983977252 learned_addr learned my addr 172.21.15.161:0/983977252 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7fa0dbfff700 1 -- 172.21.15.161:0/626646977 reap_dead start 2023-08-10T10:29:13.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7fa0e1a75700 1 -- 172.21.15.161:0/626646977 shutdown_connections 2023-08-10T10:29:13.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7fa0e1a75700 1 -- 172.21.15.161:0/626646977 >> 172.21.15.161:0/626646977 conn(0x7fa0dc0cec40 msgr2=0x7fa0dc0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 -- 172.21.15.161:0/983977252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 msgr2=0x7f74240c9640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 --2- 172.21.15.161:0/983977252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f74240c9640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 -- 172.21.15.161:0/983977252 >> v1:172.21.15.175:6789/0 conn(0x7f74240b0a70 legacy=0x7f742415e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 -- 172.21.15.161:0/983977252 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240c9fb0 con 0x7f742415aed0 2023-08-10T10:29:13.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f84c2a2c700 1 Processor -- start 2023-08-10T10:29:13.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7429b00700 1 --2- 172.21.15.161:0/983977252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f742415be00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74140098f0 tx=0x7f7414009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dae7efd7f6d1fef server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f84c2a2c700 1 -- start start 2023-08-10T10:29:13.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7428afe700 1 -- 172.21.15.161:0/983977252 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414004230 con 0x7f742415aed0 2023-08-10T10:29:13.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7428afe700 1 -- 172.21.15.161:0/983977252 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414004390 con 0x7f742415aed0 2023-08-10T10:29:13.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.895+0000 7f7428afe700 1 -- 172.21.15.161:0/983977252 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140036a0 con 0x7f742415aed0 2023-08-10T10:29:13.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f082ed9d700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] conn(0x7f0810073520 0x7f0810075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.894+0000 7f6175fb6700 1 -- 172.21.15.161:0/875867622 wait complete. 2023-08-10T10:29:13.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f6175fb6700 1 Processor -- start 2023-08-10T10:29:13.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f082ed9d700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] conn(0x7f0810073520 0x7f0810075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f6175fb6700 1 -- start start 2023-08-10T10:29:13.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f742bd64700 1 -- 172.21.15.161:0/983977252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 msgr2=0x7f742415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f742bd64700 1 --2- 172.21.15.161:0/983977252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f742415be00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74140098f0 tx=0x7f7414009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f84c2a2c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 0x7f84bc1fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.896+0000 7f84c2a2c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84bc0b0590 0x7f84bc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84c2a2c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84bc1f83e0 0x7f84bc1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84c2a2c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b0f50 con 0x7f84bc1f83e0 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84c2a2c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1f9180 con 0x7f84bc143ed0 2023-08-10T10:29:13.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84c2a2c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1f9460 con 0x7f84bc0b0590 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 0x7f84bc1fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 0x7f84bc1fa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58846/0 (socket says 172.21.15.161:58846) 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 -- 172.21.15.161:0/702928178 learned_addr learned my addr 172.21.15.161:0/702928178 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84bc0b0590 0x7f84bc0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84c0fc9700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84bc1f83e0 0x7f84bc1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== osd.4 v2:172.21.15.175:6800/3815453765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0810075ff0 con 0x7f0810073520 2023-08-10T10:29:13.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 -- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84bc0b0590 msgr2=0x7f84bc0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84bc0b0590 0x7f84bc0b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 -- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84bc1f83e0 msgr2=0x7f84bc1f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84bc1f83e0 0x7f84bc1f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc1f9740 con 0x7f84bc143ed0 2023-08-10T10:29:13.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84bc0b0590 0x7f84bc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:13.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 0x7f6170210f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700c5d10 0x7f61700c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61700c6190 0x7f61700c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61700c6ae0 con 0x7f6170210b40 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61700c8b70 con 0x7f61700c6190 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f6175fb6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61700b2980 con 0x7f61700c5d10 2023-08-10T10:29:13.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f84bbfff700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 0x7f84bc1fa220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ba80 tx=0x7f84b400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f616f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 0x7f6170210f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f616ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61700c6190 0x7f61700c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f616f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 0x7f6170210f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60054/0 (socket says 172.21.15.161:60054) 2023-08-10T10:29:13.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.897+0000 7f616f7fe700 1 -- 172.21.15.161:0/247181100 learned_addr learned my addr 172.21.15.161:0/247181100 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f68183d5700 1 Processor -- start 2023-08-10T10:29:13.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f68183d5700 1 -- start start 2023-08-10T10:29:13.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 -- 172.21.15.161:0/247181100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700c5d10 msgr2=0x7f61700c80f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61700c5d10 0x7f61700c80f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 -- 172.21.15.161:0/247181100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61700c6190 msgr2=0x7f61700c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61700c6190 0x7f61700c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 -- 172.21.15.161:0/247181100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700b26a0 con 0x7f6170210b40 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400c930 con 0x7f84bc143ed0 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400ca90 con 0x7f84bc143ed0 2023-08-10T10:29:13.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400ce40 con 0x7f84bc143ed0 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc1f9a20 con 0x7f84bc143ed0 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc1442b0 con 0x7f84bc143ed0 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7fa0e1a75700 1 -- 172.21.15.161:0/626646977 shutdown_connections 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7fa0e1a75700 1 -- 172.21.15.161:0/626646977 wait complete. 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.898+0000 7f616f7fe700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 0x7f6170210f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f615800cb30 tx=0x7f6164001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640074e0 con 0x7f6170210b40 2023-08-10T10:29:13.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164007640 con 0x7f6170210b40 2023-08-10T10:29:13.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164001110 con 0x7f6170210b40 2023-08-10T10:29:13.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f6175fb6700 1 -- 172.21.15.161:0/247181100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61700b2ce0 con 0x7f6170210b40 2023-08-10T10:29:13.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f6175fb6700 1 -- 172.21.15.161:0/247181100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61700b32a0 con 0x7f6170210b40 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f68183d5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68100660d0 0x7f68100b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f68183d5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6810071e80 con 0x7f68100cd350 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f68183d5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6810070400 con 0x7f681015b330 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f68183d5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68100706a0 con 0x7f68100660d0 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f6816171700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f68100cd350 0x7f68100cd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37062/0 (socket says 172.21.15.161:37062) 2023-08-10T10:29:13.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f6816171700 1 -- 172.21.15.161:0/2461844468 learned_addr learned my addr 172.21.15.161:0/2461844468 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f742bd64700 1 -- 172.21.15.161:0/983977252 shutdown_connections 2023-08-10T10:29:13.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f742bd64700 1 --2- 172.21.15.161:0/983977252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f742415be00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f742bd64700 1 --2- 172.21.15.161:0/983977252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f74240c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.899+0000 7f742bd64700 1 -- 172.21.15.161:0/983977252 >> 172.21.15.161:0/983977252 conn(0x7f74240cba70 msgr2=0x7f74240cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f742bd64700 1 -- 172.21.15.161:0/983977252 shutdown_connections 2023-08-10T10:29:13.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f849c000fc0 con 0x7f84bc143ed0 2023-08-10T10:29:13.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f6816972700 1 --2- 172.21.15.161:0/2461844468 >> v2:172.21.15.161:3300/0 conn(0x7f68100660d0 0x7f68100b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f6816972700 1 -- 172.21.15.161:0/2461844468 >> v1:172.21.15.175:6789/0 conn(0x7f681015b330 legacy=0x7f681006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f6816972700 1 -- 172.21.15.161:0/2461844468 >> v1:172.21.15.161:6789/0 conn(0x7f68100cd350 legacy=0x7f68100cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f6816972700 1 -- 172.21.15.161:0/2461844468 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100720b0 con 0x7f68100660d0 2023-08-10T10:29:13.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84b401d3b0 con 0x7f84bc143ed0 2023-08-10T10:29:13.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f84b8ff9700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84a806adb0 0x7f84a806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84b4089140 con 0x7f84bc143ed0 2023-08-10T10:29:13.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f84b8ff9700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] conn(0x7f84a8073670 0x7f84a8075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84a8076140 con 0x7f84a8073670 2023-08-10T10:29:13.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84b408b760 con 0x7f84bc143ed0 2023-08-10T10:29:13.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.901+0000 7f6816972700 1 --2- 172.21.15.161:0/2461844468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f68100b2320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f680c009840 tx=0x7f680c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3719da022809080b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7f84c0fc9700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] conn(0x7f84a8073670 0x7f84a8075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.900+0000 7f742bd64700 1 -- 172.21.15.161:0/983977252 wait complete. 2023-08-10T10:29:13.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7fa0e1a75700 1 Processor -- start 2023-08-10T10:29:13.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7f742bd64700 1 Processor -- start 2023-08-10T10:29:13.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7fa0e1a75700 1 -- start start 2023-08-10T10:29:13.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7f84c0fc9700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] conn(0x7f84a8073670 0x7f84a8075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== osd.0 v2:172.21.15.161:6824/4294644142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f84a8076140 con 0x7f84a8073670 2023-08-10T10:29:13.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc0aa1b0 0x7fa0dc0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0dc0b2ea0 0x7fa0dc0aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0aaad0 0x7fa0dc15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0a8800 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.902+0000 7f742bd64700 1 -- start start 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f742415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240b0a70 0x7f74240b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f74240b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74241f3780 con 0x7f742415aed0 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74241f0bb0 con 0x7f74240b0a70 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742bd64700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74241f0e90 con 0x7f74240700a0 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742a301700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f74240b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742a301700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f74240b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60064/0 (socket says 172.21.15.161:60064) 2023-08-10T10:29:13.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f742a301700 1 -- 172.21.15.161:0/2139777348 learned_addr learned my addr 172.21.15.161:0/2139777348 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7f7429b00700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f742415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b41f0 con 0x7fa0dc0aa1b0 2023-08-10T10:29:13.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0e1a75700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b3320 con 0x7fa0dc0aaad0 2023-08-10T10:29:13.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc0aa1b0 0x7fa0dc0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc0aa1b0 0x7fa0dc0b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58872/0 (socket says 172.21.15.161:58872) 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.903+0000 7fa0db7fe700 1 -- 172.21.15.161:0/3060157004 learned_addr learned my addr 172.21.15.161:0/3060157004 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0dc0b2ea0 0x7fa0dc0aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 -- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240b0a70 msgr2=0x7f74240b2ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240b0a70 0x7f74240b2ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 -- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 msgr2=0x7f74240b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f742415aed0 0x7f74240b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009550 con 0x7f74240700a0 2023-08-10T10:29:13.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6164022070 con 0x7f6170210b40 2023-08-10T10:29:13.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f681516f700 1 -- 172.21.15.161:0/2461844468 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c004230 con 0x7f68100660d0 2023-08-10T10:29:13.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f681516f700 1 -- 172.21.15.161:0/2461844468 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c004390 con 0x7f68100660d0 2023-08-10T10:29:13.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f681516f700 1 -- 172.21.15.161:0/2461844468 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0036a0 con 0x7f68100660d0 2023-08-10T10:29:13.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f7429b00700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f742415a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7414015000 tx=0x7f7414004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 -- 172.21.15.161:0/3060157004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0aaad0 msgr2=0x7fa0dc15b580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0dc0aaad0 0x7fa0dc15b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 -- 172.21.15.161:0/3060157004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc0aa1b0 msgr2=0x7fa0dc0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc0aa1b0 0x7fa0dc0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0b35e0 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7fa0daffd700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0dc0b2ea0 0x7fa0dc0aa590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc016000 tx=0x7fa0cc001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc001100 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0052d0 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc0b38c0 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc003680 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc0b3e80 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f6157fff700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f615c06ad30 0x7f615c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f616408ac60 con 0x7f6170210b40 2023-08-10T10:29:13.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f68183d5700 1 -- 172.21.15.161:0/2461844468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 msgr2=0x7f68100b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f68183d5700 1 --2- 172.21.15.161:0/2461844468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f68100b2320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f680c009840 tx=0x7f680c009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:13.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400b660 con 0x7f74240700a0 2023-08-10T10:29:13.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400b7e0 con 0x7f74240700a0 2023-08-10T10:29:13.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400bb90 con 0x7f74240700a0 2023-08-10T10:29:13.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74241f3130 con 0x7f74240700a0 2023-08-10T10:29:13.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.904+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74241efe80 con 0x7f74240700a0 2023-08-10T10:29:13.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.905+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74241f1000 con 0x7f74240700a0 2023-08-10T10:29:13.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f616effd700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f615c06ad30 0x7f615c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0dc06bc30 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f6155ffb700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] conn(0x7f61700c3cd0 0x7f61700c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 --> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f617016ab10 con 0x7f61700c3cd0 2023-08-10T10:29:13.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f616effd700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f615c06ad30 0x7f615c06d1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61700b2180 tx=0x7f6160008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f0879a6b700 1 Processor -- start 2023-08-10T10:29:13.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.907+0000 7f68183d5700 1 -- 172.21.15.161:0/2461844468 shutdown_connections 2023-08-10T10:29:13.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.907+0000 7f68183d5700 1 --2- 172.21.15.161:0/2461844468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f68100b2320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.907+0000 7f68183d5700 1 -- 172.21.15.161:0/2461844468 >> 172.21.15.161:0/2461844468 conn(0x7f68100cf450 msgr2=0x7f68100cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.907+0000 7f68183d5700 1 -- 172.21.15.161:0/2461844468 shutdown_connections 2023-08-10T10:29:13.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.907+0000 7f68183d5700 1 -- 172.21.15.161:0/2461844468 wait complete. 2023-08-10T10:29:13.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f616ffff700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] conn(0x7f61700c3cd0 0x7f61700c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.906+0000 7f0879a6b700 1 -- start start 2023-08-10T10:29:13.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f0879a6b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08740ce420 0x7f087413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f0879a6b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f087413f020 0x7f08740c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f0879a6b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087406b9e0 con 0x7f08740c9880 2023-08-10T10:29:13.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f0879a6b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087406c010 con 0x7f087413f020 2023-08-10T10:29:13.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f0879a6b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c9d10 con 0x7f08740ce420 2023-08-10T10:29:13.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f741400bcf0 con 0x7f74240700a0 2023-08-10T10:29:13.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f740806adb0 0x7f740806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f741408b2b0 con 0x7f74240700a0 2023-08-10T10:29:13.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f616ffff700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] conn(0x7f61700c3cd0 0x7f61700c40b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] conn(0x7f7408073670 0x7f7408075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7408076140 con 0x7f7408073670 2023-08-10T10:29:13.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f741408b660 con 0x7f74240700a0 2023-08-10T10:29:13.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f0873fff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f08740c9880 0x7f0874156410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:38882/0 (socket says 172.21.15.161:38882) 2023-08-10T10:29:13.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f0873fff700 1 -- 172.21.15.161:0/1169138536 learned_addr learned my addr 172.21.15.161:0/1169138536 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f68183d5700 1 Processor -- start 2023-08-10T10:29:13.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84a806adb0 0x7f84a806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.908+0000 7f84bb7fe700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84a806adb0 0x7f84a806d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b5200 tx=0x7f84b000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f74292ff700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f740806adb0 0x7f740806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08737fe700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08740ce420 0x7f087413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f742a301700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] conn(0x7f7408073670 0x7f7408075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339242331 0 0) 0x7f087406b9e0 con 0x7f08740c9880 2023-08-10T10:29:13.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f085c0035b0 con 0x7f08740c9880 2023-08-10T10:29:13.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f74292ff700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f740806adb0 0x7f740806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74240b1210 tx=0x7f7420006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587386475 0 0) 0x7f085c0035b0 con 0x7f08740c9880 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08740ce420 msgr2=0x7f087413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08740ce420 0x7f087413eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 >> v2:172.21.15.175:3300/0 conn(0x7f087413f020 msgr2=0x7f08740c9340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 --2- 172.21.15.161:0/1169138536 >> v2:172.21.15.175:3300/0 conn(0x7f087413f020 0x7f08740c9340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087413f580 con 0x7f08740c9880 2023-08-10T10:29:13.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f0864001670 con 0x7f08740c9880 2023-08-10T10:29:13.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0cc023070 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa0c806ace0 0x7fa0c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0cc08ab60 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] conn(0x7fa0c80733b0 0x7fa0c80757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0c8075e80 con 0x7fa0c80733b0 2023-08-10T10:29:13.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0cc08aed0 con 0x7fa0dc0b2ea0 2023-08-10T10:29:13.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7fa0dbfff700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] conn(0x7fa0c80733b0 0x7fa0c80757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 >> v1:172.21.15.175:6789/0 conn(0x7f08740c9880 legacy=0x7f0874156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c003a00 0x7f085c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c004850 0x7f085c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c005210 0x7f085c00fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087406c010 con 0x7f085c003a00 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c9d10 con 0x7f085c005210 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c010510 con 0x7f085c004850 2023-08-10T10:29:13.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7fa0db7fe700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa0c806ace0 0x7fa0c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c005210 0x7f085c00fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7fa0dbfff700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] conn(0x7fa0c80733b0 0x7fa0c80757d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 -- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c004850 msgr2=0x7f085c004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c004850 0x7f085c004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 -- 172.21.15.161:0/1169138536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c003a00 msgr2=0x7f085c003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c003a00 0x7f085c003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 -- 172.21.15.161:0/1169138536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087413f580 con 0x7f085c005210 2023-08-10T10:29:13.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.909+0000 7f68183d5700 1 -- start start 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f681014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 0x7f68101ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f681015b330 0x7f681014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681014d240 con 0x7f68100660d0 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681014f1b0 con 0x7f681015b330 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f68183d5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810152000 con 0x7f68100cd350 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f6815970700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 0x7f68101ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f6815970700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 0x7f68101ffa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45270/0 (socket says 172.21.15.161:45270) 2023-08-10T10:29:13.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f6815970700 1 -- 172.21.15.161:0/2339161512 learned_addr learned my addr 172.21.15.161:0/2339161512 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7fa0db7fe700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa0c806ace0 0x7fa0c806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0004120 tx=0x7fa0d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f6816171700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f681014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f0873fff700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c005210 0x7f085c00fe20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f086400c3f0 tx=0x7f085c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ff072f126a158 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 -- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f681015b330 msgr2=0x7f681014f6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f681015b330 0x7f681014f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 -- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 msgr2=0x7f681014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68100660d0 0x7f681014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0094a0 con 0x7f68100cd350 2023-08-10T10:29:13.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.910+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== osd.2 v2:172.21.15.161:6808/3808745509 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f61680020a0 con 0x7f61700c3cd0 2023-08-10T10:29:13.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864005960 con 0x7f085c005210 2023-08-10T10:29:13.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864005ac0 con 0x7f085c005210 2023-08-10T10:29:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f08727fc700 1 -- 172.21.15.161:0/1169138536 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864005e70 con 0x7f085c005210 2023-08-10T10:29:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6815970700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 0x7f68101ffa20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f680000c4a0 tx=0x7f680000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000054e0 con 0x7f68100cd350 2023-08-10T10:29:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800003680 con 0x7f68100cd350 2023-08-10T10:29:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681014c630 con 0x7f68100cd350 2023-08-10T10:29:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800003a10 con 0x7f68100cd350 2023-08-10T10:29:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.911+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681014cbf0 con 0x7f68100cd350 2023-08-10T10:29:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f742a301700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] conn(0x7f7408073670 0x7f7408075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 -- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c005210 msgr2=0x7f085c00fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 --2- 172.21.15.161:0/1169138536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c005210 0x7f085c00fe20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f086400c3f0 tx=0x7f085c005880 comp rx=0 tx=0).stop 2023-08-10T10:29:13.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0873fff700 1 -- 172.21.15.161:0/1169138536 reap_dead start 2023-08-10T10:29:13.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 -- 172.21.15.161:0/1169138536 shutdown_connections 2023-08-10T10:29:13.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 -- 172.21.15.161:0/1169138536 >> 172.21.15.161:0/1169138536 conn(0x7f08740cec40 msgr2=0x7f08740cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== osd.1 v2:172.21.15.161:6809/77291645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa0c8075e80 con 0x7fa0c80733b0 2023-08-10T10:29:13.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 -- 172.21.15.161:0/1169138536 shutdown_connections 2023-08-10T10:29:13.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f0879a6b700 1 -- 172.21.15.161:0/1169138536 wait complete. 2023-08-10T10:29:13.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67f8000fc0 con 0x7f68100cd350 2023-08-10T10:29:13.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.912+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== osd.6 v2:172.21.15.175:6808/4196020712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7408076140 con 0x7f7408073670 2023-08-10T10:29:13.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.913+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6800003b70 con 0x7f68100cd350 2023-08-10T10:29:13.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.914+0000 7f6806ffd700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f67f406ad30 0x7f67f406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.914+0000 7f6816171700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f67f406ad30 0x7f67f406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6800088550 con 0x7f68100cd350 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6816171700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f67f406ad30 0x7f67f406d1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6808001f00 tx=0x7f6808001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6806ffd700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] conn(0x7f67f40734f0 0x7f67f4075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67f4075fc0 con 0x7f67f40734f0 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68000011c0 con 0x7f68100cd350 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6816972700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] conn(0x7f67f40734f0 0x7f67f4075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.913+0000 7f66174a0700 1 Processor -- start 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.913+0000 7f66174a0700 1 -- start start 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f66174a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66100c2350 0x7f66100ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f66174a0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66100caec0 0x7f66101650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f66174a0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100cd880 con 0x7f6610165630 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f66174a0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6610165ac0 con 0x7f66100caec0 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f66174a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cd2c0 con 0x7f66100c2350 2023-08-10T10:29:13.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6615a3d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6610165630 0x7f6610161ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37114/0 (socket says 172.21.15.161:37114) 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6615a3d700 1 -- 172.21.15.161:0/11488113 learned_addr learned my addr 172.21.15.161:0/11488113 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6614a3b700 1 --2- 172.21.15.161:0/11488113 >> v2:172.21.15.175:3300/0 conn(0x7f66100caec0 0x7f66101650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662272293 0 0) 0x7f66100cd880 con 0x7f6610165630 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65fc0035b0 con 0x7f6610165630 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998536262 0 0) 0x7f65fc0035b0 con 0x7f6610165630 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66100c2350 msgr2=0x7f66100ce690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66100c2350 0x7f66100ce690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 >> v2:172.21.15.175:3300/0 conn(0x7f66100caec0 msgr2=0x7f66101650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 --2- 172.21.15.161:0/11488113 >> v2:172.21.15.175:3300/0 conn(0x7f66100caec0 0x7f66101650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100cd5a0 con 0x7f6610165630 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f66080019f0 con 0x7f6610165630 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 >> v1:172.21.15.161:6789/0 conn(0x7f6610165630 legacy=0x7f6610161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65fc003a00 0x7f65fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65fc004850 0x7f65fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65fc005210 0x7f65fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610165ac0 con 0x7f65fc004850 2023-08-10T10:29:13.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cd2c0 con 0x7f65fc005210 2023-08-10T10:29:13.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc00c100 con 0x7f65fc003a00 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.914+0000 7f0879a6b700 1 Processor -- start 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.914+0000 7f0879a6b700 1 -- start start 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f0879a6b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c005210 0x7f08741f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f0879a6b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08741e03a0 0x7f0874200520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f0879a6b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 0x7f08740c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.915+0000 7f0879a6b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08741e4030 con 0x7f0874200a60 2023-08-10T10:29:13.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0879a6b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08741e3000 con 0x7f08741e03a0 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0879a6b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08741e3270 con 0x7f085c005210 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 0x7f08740c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 0x7f08740c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60114/0 (socket says 172.21.15.161:60114) 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 -- 172.21.15.161:0/2924959204 learned_addr learned my addr 172.21.15.161:0/2924959204 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 -- 172.21.15.161:0/2924959204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c005210 msgr2=0x7f08741f6690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085c005210 0x7f08741f6690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 -- 172.21.15.161:0/2924959204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08741e03a0 msgr2=0x7f0874200520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08741e03a0 0x7f0874200520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08741e3550 con 0x7f0874200a60 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.916+0000 7f0873fff700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 0x7f08740c4270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f086400c290 tx=0x7f0864001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.917+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864004c80 con 0x7f0874200a60 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.917+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864004e00 con 0x7f0874200a60 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.917+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741e4030 con 0x7f0874200a60 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.917+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864007310 con 0x7f0874200a60 2023-08-10T10:29:13.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.917+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08741e3b10 con 0x7f0874200a60 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.918+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f087406bc30 con 0x7f0874200a60 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.920+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0864007470 con 0x7f0874200a60 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.920+0000 7f085bfff700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f086006ace0 0x7f086006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.920+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f086408ae30 con 0x7f0874200a60 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.921+0000 7f085bfff700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] conn(0x7f0860073520 0x7f0860075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.921+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0860075ff0 con 0x7f0860073520 2023-08-10T10:29:13.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.921+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f086408b280 con 0x7f0874200a60 2023-08-10T10:29:13.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65fc004850 0x7f65fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6615a3d700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65fc005210 0x7f65fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f08737fe700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f086006ace0 0x7f086006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6816972700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] conn(0x7f67f40734f0 0x7f67f4075910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 -- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65fc003a00 msgr2=0x7f65fc003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:13.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65fc003a00 0x7f65fc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 -- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65fc005210 msgr2=0x7f65fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65fc005210 0x7f65fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.922+0000 7f6614a3b700 1 -- 172.21.15.161:0/11488113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100cd5a0 con 0x7f65fc004850 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.923+0000 7f6614a3b700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65fc004850 0x7f65fc004cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6604009880 tx=0x7f65fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b87e95601b1d958 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.923+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400c070 con 0x7f65fc004850 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.923+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604013610 con 0x7f65fc004850 2023-08-10T10:29:13.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.923+0000 7f6603fff700 1 -- 172.21.15.161:0/11488113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604013980 con 0x7f65fc004850 2023-08-10T10:29:13.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.923+0000 7f08737fe700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f086006ace0 0x7f086006d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08740c9450 tx=0x7f086c0075f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.924+0000 7f0872ffd700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] conn(0x7f0860073520 0x7f0860075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.924+0000 7f66174a0700 1 -- 172.21.15.161:0/11488113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65fc004850 msgr2=0x7f65fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.924+0000 7f66174a0700 1 --2- 172.21.15.161:0/11488113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65fc004850 0x7f65fc004cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6604009880 tx=0x7f65fc005880 comp rx=0 tx=0).stop 2023-08-10T10:29:13.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.924+0000 7f0872ffd700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] conn(0x7f0860073520 0x7f0860075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.925+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== osd.3 v2:172.21.15.161:6800/728219313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0860075ff0 con 0x7f0860073520 2023-08-10T10:29:13.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f6615a3d700 1 -- 172.21.15.161:0/11488113 reap_dead start 2023-08-10T10:29:13.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== osd.5 v2:172.21.15.175:6824/902060377 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f67f4075fc0 con 0x7f67f40734f0 2023-08-10T10:29:13.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 --> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f083016ab10 con 0x7f0810073520 2023-08-10T10:29:13.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f66174a0700 1 -- 172.21.15.161:0/11488113 shutdown_connections 2023-08-10T10:29:13.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f66174a0700 1 -- 172.21.15.161:0/11488113 >> 172.21.15.161:0/11488113 conn(0x7f66100cec40 msgr2=0x7f66100cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f66174a0700 1 -- 172.21.15.161:0/11488113 shutdown_connections 2023-08-10T10:29:13.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.928+0000 7f66174a0700 1 -- 172.21.15.161:0/11488113 wait complete. 2023-08-10T10:29:13.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.929+0000 7f081effd700 1 -- 172.21.15.161:0/402113209 <== osd.4 v2:172.21.15.175:6800/3815453765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0820023040 con 0x7f0810073520 2023-08-10T10:29:13.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.930+0000 7f66174a0700 1 Processor -- start 2023-08-10T10:29:13.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.930+0000 7f66174a0700 1 -- start start 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f661006fdd0 0x7f66100b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661016cf30 0x7f6610163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 0x7f66100c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610166200 con 0x7f66100701b0 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100b3870 con 0x7f661016cf30 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f66174a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6610164720 con 0x7f661006fdd0 2023-08-10T10:29:13.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 0x7f66100c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 0x7f66100c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60128/0 (socket says 172.21.15.161:60128) 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 -- 172.21.15.161:0/1747122497 learned_addr learned my addr 172.21.15.161:0/1747122497 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 -- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f661006fdd0 msgr2=0x7f66100b42c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f661006fdd0 0x7f66100b42c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 -- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661016cf30 msgr2=0x7f6610163db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661016cf30 0x7f6610163db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 -- 172.21.15.161:0/1747122497 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610164a00 con 0x7f66100701b0 2023-08-10T10:29:13.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.932+0000 7f6615a3d700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 0x7f66100c3c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f661006dc50 tx=0x7f6608001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.933+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800ecf0 con 0x7f66100701b0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.933+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800ee50 con 0x7f66100701b0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.933+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608013640 con 0x7f66100701b0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.933+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66100b3ac0 con 0x7f66100701b0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.934+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66101642f0 con 0x7f66100701b0 2023-08-10T10:29:13.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.935+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 --> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f849c002d40 con 0x7f84a8073670 2023-08-10T10:29:13.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.935+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66080137a0 con 0x7f66100701b0 2023-08-10T10:29:13.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.936+0000 7f6601ffb700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f65fc06c6e0 0x7f65fc06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.936+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6608089b20 con 0x7f66100701b0 2023-08-10T10:29:13.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.936+0000 7f84b8ff9700 1 -- 172.21.15.161:0/702928178 <== osd.0 v2:172.21.15.161:6824/4294644142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f849c002d40 con 0x7f84a8073670 2023-08-10T10:29:13.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.936+0000 7f66174a0700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] conn(0x7f6610163510 0x7f6610151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:13.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.936+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 --> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66100c9680 con 0x7f6610163510 2023-08-10T10:29:13.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.937+0000 7f661523c700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f65fc06c6e0 0x7f65fc06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.937+0000 7f6614a3b700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] conn(0x7f6610163510 0x7f6610151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:13.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.937+0000 7f661523c700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f65fc06c6e0 0x7f65fc06eba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f660c006fd0 tx=0x7f660c006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.937+0000 7f6614a3b700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] conn(0x7f6610163510 0x7f6610151870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:13.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 --> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61700c97c0 con 0x7f61700c3cd0 2023-08-10T10:29:13.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== osd.7 v2:172.21.15.175:6816/996591933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6604009550 con 0x7f6610163510 2023-08-10T10:29:13.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] conn(0x7f0810073520 msgr2=0x7f0810075940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.175:6800/3815453765,v1:172.21.15.175:6801/3815453765] conn(0x7f0810073520 0x7f0810075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:13.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f081006ace0 msgr2=0x7f081006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f081006ace0 0x7f081006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0828007270 tx=0x7f082800b040 comp rx=0 tx=0).stop 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 msgr2=0x7f0830088330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.938+0000 7f0834893700 1 --2- 172.21.15.161:0/402113209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08300c7970 0x7f0830088330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0830072110 tx=0x7f082400e840 comp rx=0 tx=0).stop 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.939+0000 7f082ed9d700 1 -- 172.21.15.161:0/402113209 reap_dead start 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.939+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 shutdown_connections 2023-08-10T10:29:13.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.939+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 >> 172.21.15.161:0/402113209 conn(0x7f08300cec40 msgr2=0x7f0830071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:13.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.939+0000 7f6157fff700 1 -- 172.21.15.161:0/247181100 <== osd.2 v2:172.21.15.161:6808/3808745509 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6168001ca0 con 0x7f61700c3cd0 2023-08-10T10:29:13.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] conn(0x7f61700c3cd0 msgr2=0x7f61700c40b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6808/3808745509,v1:172.21.15.161:6810/3808745509] conn(0x7f61700c3cd0 0x7f61700c40b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f615c06ad30 msgr2=0x7f615c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f615c06ad30 0x7f615c06d1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61700b2180 tx=0x7f6160008040 comp rx=0 tx=0).stop 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 msgr2=0x7f6170210f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 --2- 172.21.15.161:0/247181100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6170210b40 0x7f6170210f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f615800cb30 tx=0x7f6164001b90 comp rx=0 tx=0).stop 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f616ffff700 1 -- 172.21.15.161:0/247181100 reap_dead start 2023-08-10T10:29:14.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 shutdown_connections 2023-08-10T10:29:14.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 >> 172.21.15.161:0/247181100 conn(0x7f61700cec40 msgr2=0x7f6170169940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 shutdown_connections 2023-08-10T10:29:14.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f6155ffb700 1 -- 172.21.15.161:0/247181100 wait complete. 2023-08-10T10:29:14.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 shutdown_connections 2023-08-10T10:29:14.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f0834893700 1 -- 172.21.15.161:0/402113209 wait complete. 2023-08-10T10:29:14.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 --> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0dc0744e0 con 0x7fa0c80733b0 2023-08-10T10:29:14.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7fa0c3fff700 1 -- 172.21.15.161:0/3060157004 <== osd.1 v2:172.21.15.161:6809/77291645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0dc0744e0 con 0x7fa0c80733b0 2023-08-10T10:29:14.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.942+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 --> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f742415b600 con 0x7f7408073670 2023-08-10T10:29:14.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.942+0000 7f741a7fc700 1 -- 172.21.15.161:0/2139777348 <== osd.6 v2:172.21.15.175:6808/4196020712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f741c001c60 con 0x7f7408073670 2023-08-10T10:29:14.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] conn(0x7f84a8073670 msgr2=0x7f84a8075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6824/4294644142,v1:172.21.15.161:6825/4294644142] conn(0x7f84a8073670 0x7f84a8075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84a806adb0 msgr2=0x7f84a806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f84a806adb0 0x7f84a806d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b5200 tx=0x7f84b000a000 comp rx=0 tx=0).stop 2023-08-10T10:29:14.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 msgr2=0x7f84bc1fa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c2a2c700 1 --2- 172.21.15.161:0/702928178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84bc143ed0 0x7f84bc1fa220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ba80 tx=0x7f84b400bd90 comp rx=0 tx=0).stop 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.940+0000 7f84c0fc9700 1 -- 172.21.15.161:0/702928178 reap_dead start 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 shutdown_connections 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 >> 172.21.15.161:0/702928178 conn(0x7f84bc0cfd70 msgr2=0x7f84bc1537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 shutdown_connections 2023-08-10T10:29:14.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.941+0000 7f84c2a2c700 1 -- 172.21.15.161:0/702928178 wait complete. 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] conn(0x7f7408073670 msgr2=0x7f7408075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:6808/4196020712,v1:172.21.15.175:6809/4196020712] conn(0x7f7408073670 0x7f7408075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f740806adb0 msgr2=0x7f740806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f740806adb0 0x7f740806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74240b1210 tx=0x7f7420006c60 comp rx=0 tx=0).stop 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 msgr2=0x7f742415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 --2- 172.21.15.161:0/2139777348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240700a0 0x7f742415a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7414015000 tx=0x7f7414004750 comp rx=0 tx=0).stop 2023-08-10T10:29:14.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742a301700 1 -- 172.21.15.161:0/2139777348 reap_dead start 2023-08-10T10:29:14.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 shutdown_connections 2023-08-10T10:29:14.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.950+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 >> 172.21.15.161:0/2139777348 conn(0x7f74240cba70 msgr2=0x7f74240aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 shutdown_connections 2023-08-10T10:29:14.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7f742bd64700 1 -- 172.21.15.161:0/2139777348 wait complete. 2023-08-10T10:29:14.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] conn(0x7fa0c80733b0 msgr2=0x7fa0c80757d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6809/77291645,v1:172.21.15.161:6811/77291645] conn(0x7fa0c80733b0 0x7fa0c80757d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa0c806ace0 msgr2=0x7fa0c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa0c806ace0 0x7fa0c806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0004120 tx=0x7fa0d0009040 comp rx=0 tx=0).stop 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0dc0b2ea0 msgr2=0x7fa0dc0aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0e1a75700 1 --2- 172.21.15.161:0/3060157004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0dc0b2ea0 0x7fa0dc0aa590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc016000 tx=0x7fa0cc001970 comp rx=0 tx=0).stop 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.951+0000 7fa0dbfff700 1 -- 172.21.15.161:0/3060157004 reap_dead start 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.954+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 shutdown_connections 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.954+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 >> 172.21.15.161:0/3060157004 conn(0x7fa0dc0cec40 msgr2=0x7fa0dc0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.957+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 shutdown_connections 2023-08-10T10:29:14.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.957+0000 7fa0e1a75700 1 -- 172.21.15.161:0/3060157004 wait complete. 2023-08-10T10:29:14.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.957+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 --> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f087413f860 con 0x7f0860073520 2023-08-10T10:29:14.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.958+0000 7f085bfff700 1 -- 172.21.15.161:0/2924959204 <== osd.3 v2:172.21.15.161:6800/728219313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0868009280 con 0x7f0860073520 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.959+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] conn(0x7f0860073520 msgr2=0x7f0860075940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.959+0000 7f0879a6b700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6800/728219313,v1:172.21.15.161:6801/728219313] conn(0x7f0860073520 0x7f0860075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.960+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f086006ace0 msgr2=0x7f086006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.960+0000 7f0879a6b700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f086006ace0 0x7f086006d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08740c9450 tx=0x7f086c0075f0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.960+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 msgr2=0x7f08740c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.960+0000 7f0879a6b700 1 --2- 172.21.15.161:0/2924959204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0874200a60 0x7f08740c4270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f086400c290 tx=0x7f0864001930 comp rx=0 tx=0).stop 2023-08-10T10:29:14.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.960+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 --> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67f8002d40 con 0x7f67f40734f0 2023-08-10T10:29:14.011 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.961+0000 7f0873fff700 1 -- 172.21.15.161:0/2924959204 reap_dead start 2023-08-10T10:29:14.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.961+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 shutdown_connections 2023-08-10T10:29:14.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.961+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 >> 172.21.15.161:0/2924959204 conn(0x7f08740cec40 msgr2=0x7f08740b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.961+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 shutdown_connections 2023-08-10T10:29:14.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.961+0000 7f0879a6b700 1 -- 172.21.15.161:0/2924959204 wait complete. 2023-08-10T10:29:14.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.962+0000 7f6806ffd700 1 -- 172.21.15.161:0/2339161512 <== osd.5 v2:172.21.15.175:6824/902060377 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67f8002d40 con 0x7f67f40734f0 2023-08-10T10:29:14.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-10T10:29:14.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.963+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] conn(0x7f67f40734f0 msgr2=0x7f67f4075910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.963+0000 7f68183d5700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:6824/902060377,v1:172.21.15.175:6825/902060377] conn(0x7f67f40734f0 0x7f67f4075910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.014 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2023-08-10T10:29:14.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-10T10:29:14.016 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-10T10:29:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.965+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f67f406ad30 msgr2=0x7f67f406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.965+0000 7f68183d5700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f67f406ad30 0x7f67f406d1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6808001f00 tx=0x7f6808001e90 comp rx=0 tx=0).stop 2023-08-10T10:29:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.965+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 msgr2=0x7f68101ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.965+0000 7f68183d5700 1 --2- 172.21.15.161:0/2339161512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68100cd350 0x7f68101ffa20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f680000c4a0 tx=0x7f680000c7b0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.965+0000 7f6816972700 1 -- 172.21.15.161:0/2339161512 reap_dead start 2023-08-10T10:29:14.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.966+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 --> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66100c93a0 con 0x7f6610163510 2023-08-10T10:29:14.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f6601ffb700 1 -- 172.21.15.161:0/1747122497 <== osd.7 v2:172.21.15.175:6816/996591933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6604013780 con 0x7f6610163510 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] conn(0x7f6610163510 msgr2=0x7f6610151870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.175:6816/996591933,v1:172.21.15.175:6817/996591933] conn(0x7f6610163510 0x7f6610151870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f65fc06c6e0 msgr2=0x7f65fc06eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f65fc06c6e0 0x7f65fc06eba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f660c006fd0 tx=0x7f660c006c40 comp rx=0 tx=0).stop 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 msgr2=0x7f66100c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 --2- 172.21.15.161:0/1747122497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100701b0 0x7f66100c3c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f661006dc50 tx=0x7f6608001ae0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f6615a3d700 1 -- 172.21.15.161:0/1747122497 reap_dead start 2023-08-10T10:29:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 shutdown_connections 2023-08-10T10:29:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 >> 172.21.15.161:0/1747122497 conn(0x7f66100cec40 msgr2=0x7f66100718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 shutdown_connections 2023-08-10T10:29:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.967+0000 7f66174a0700 1 -- 172.21.15.161:0/1747122497 wait complete. 2023-08-10T10:29:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.970+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 shutdown_connections 2023-08-10T10:29:14.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.970+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 >> 172.21.15.161:0/2339161512 conn(0x7f68100cf450 msgr2=0x7f68100b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.972+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 shutdown_connections 2023-08-10T10:29:14.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:13.972+0000 7f68183d5700 1 -- 172.21.15.161:0/2339161512 wait complete. 2023-08-10T10:29:14.021 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-10T10:29:14.022 INFO:teuthology.orchestra.run.smithi161.stdout:55834574858 2023-08-10T10:29:14.023 INFO:teuthology.orchestra.run.smithi161.stdout:55834574858 2023-08-10T10:29:14.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-10T10:29:14.024 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-10T10:29:14.025 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.025 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-10T10:29:14.026 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-10T10:29:14.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.259+0000 7fcf30183700 1 Processor -- start 2023-08-10T10:29:14.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.259+0000 7fcf30183700 1 -- start start 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf30183700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280ce420 0x7fcf2813eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf30183700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcf280cf760 0x7fcf28156410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf30183700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2806b9e0 con 0x7fcf2813f020 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf30183700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806c010 con 0x7fcf280cf760 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf30183700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2813f580 con 0x7fcf280ce420 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf2d71e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcf280cf760 0x7fcf28156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf2d71e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcf280cf760 0x7fcf28156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58942/0 (socket says 172.21.15.161:58942) 2023-08-10T10:29:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf2d71e700 1 -- 172.21.15.161:0/2456267797 learned_addr learned my addr 172.21.15.161:0/2456267797 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.261+0000 7fcf2df1f700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280ce420 0x7fcf2813eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.262+0000 7fcf2d71e700 1 -- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280ce420 msgr2=0x7fcf2813eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.262+0000 7fcf2d71e700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280ce420 0x7fcf2813eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.262+0000 7fcf2d71e700 1 -- 172.21.15.161:0/2456267797 >> v1:172.21.15.161:6789/0 conn(0x7fcf2813f020 legacy=0x7fcf28156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.262+0000 7fcf2d71e700 1 -- 172.21.15.161:0/2456267797 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2813f860 con 0x7fcf280cf760 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.263+0000 7fcf2d71e700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280cf760 0x7fcf28156410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf240098f0 tx=0x7fcf24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117ecfba72f4cf02 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.263+0000 7fcf2cf1d700 1 -- 172.21.15.161:0/2456267797 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400b8a0 con 0x7fcf280cf760 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.263+0000 7fcf2cf1d700 1 -- 172.21.15.161:0/2456267797 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2400ba00 con 0x7fcf280cf760 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.263+0000 7fcf2cf1d700 1 -- 172.21.15.161:0/2456267797 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400bd90 con 0x7fcf280cf760 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 -- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280cf760 msgr2=0x7fcf28156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280cf760 0x7fcf28156410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf240098f0 tx=0x7fcf24009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 -- 172.21.15.161:0/2456267797 shutdown_connections 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280ce420 0x7fcf2813eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 --2- 172.21.15.161:0/2456267797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280cf760 0x7fcf28156410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 -- 172.21.15.161:0/2456267797 >> 172.21.15.161:0/2456267797 conn(0x7fcf280cec40 msgr2=0x7fcf280cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 -- 172.21.15.161:0/2456267797 shutdown_connections 2023-08-10T10:29:14.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fcf30183700 1 -- 172.21.15.161:0/2456267797 wait complete. 2023-08-10T10:29:14.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fb2af366700 1 Processor -- start 2023-08-10T10:29:14.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.264+0000 7fb2af366700 1 -- start start 2023-08-10T10:29:14.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fcf30183700 1 Processor -- start 2023-08-10T10:29:14.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2af366700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a81651c0 0x7fb2a8165d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2af366700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2a81655a0 0x7fb2a80cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2af366700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a80ce970 con 0x7fb2a806b9e0 2023-08-10T10:29:14.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2af366700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a80ce3b0 con 0x7fb2a81655a0 2023-08-10T10:29:14.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2af366700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a80ce690 con 0x7fb2a81651c0 2023-08-10T10:29:14.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fcf30183700 1 -- start start 2023-08-10T10:29:14.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2ad903700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb2a806b9e0 0x7fb2a80cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37152/0 (socket says 172.21.15.161:37152) 2023-08-10T10:29:14.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2ad903700 1 -- 172.21.15.161:0/2022721623 learned_addr learned my addr 172.21.15.161:0/2022721623 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:14.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb2ac901700 1 --2- 172.21.15.161:0/2022721623 >> v2:172.21.15.175:3300/0 conn(0x7fb2a81655a0 0x7fb2a80cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb29ffff700 1 -- 172.21.15.161:0/2022721623 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240904893 0 0) 0x7fb2a80ce970 con 0x7fb2a806b9e0 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.266+0000 7fb29ffff700 1 -- 172.21.15.161:0/2022721623 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2940035b0 con 0x7fb2a806b9e0 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ad102700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a81651c0 0x7fb2a8165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ac901700 1 -- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a81651c0 msgr2=0x7fb2a8165d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ac901700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a81651c0 0x7fb2a8165d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ac901700 1 -- 172.21.15.161:0/2022721623 >> v1:172.21.15.161:6789/0 conn(0x7fb2a806b9e0 legacy=0x7fb2a80cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ac901700 1 -- 172.21.15.161:0/2022721623 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80c93c0 con 0x7fb2a81655a0 2023-08-10T10:29:14.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf280ce420 0x7fcf280c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf2813f020 0x7fcf2814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280b2490 con 0x7fcf280ce420 2023-08-10T10:29:14.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2814f050 con 0x7fcf2813f020 2023-08-10T10:29:14.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf30183700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2814f330 con 0x7fcf280cf760 2023-08-10T10:29:14.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb2ac901700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81655a0 0x7fb2a80cae90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ecc1f145b11e27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf2d71e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf2d71e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45322/0 (socket says 172.21.15.161:45322) 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf2d71e700 1 -- 172.21.15.161:0/3994818270 learned_addr learned my addr 172.21.15.161:0/3994818270 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf2e720700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf2813f020 0x7fcf2814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fcf2df1f700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf280ce420 0x7fcf280c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb29ffff700 1 -- 172.21.15.161:0/2022721623 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011830 con 0x7fb2a81655a0 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb29ffff700 1 -- 172.21.15.161:0/2022721623 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4011990 con 0x7fb2a81655a0 2023-08-10T10:29:14.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.267+0000 7fb29ffff700 1 -- 172.21.15.161:0/2022721623 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011d20 con 0x7fb2a81655a0 2023-08-10T10:29:14.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 -- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf2813f020 msgr2=0x7fcf2814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf2813f020 0x7fcf2814e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 -- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf280ce420 msgr2=0x7fcf280c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf280ce420 0x7fcf280c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 -- 172.21.15.161:0/3994818270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf24009550 con 0x7fcf280cf760 2023-08-10T10:29:14.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf2d71e700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009c40 tx=0x7fcf24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7f328d46a700 1 Processor -- start 2023-08-10T10:29:14.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7f328d46a700 1 -- start start 2023-08-10T10:29:14.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24004380 con 0x7fcf280cf760 2023-08-10T10:29:14.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.268+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2401f070 con 0x7fcf280cf760 2023-08-10T10:29:14.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f58314e3700 1 Processor -- start 2023-08-10T10:29:14.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240036a0 con 0x7fcf280cf760 2023-08-10T10:29:14.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f328d46a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32880cad90 0x7f3288071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f328d46a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32880cc810 0x7f328815f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f328d46a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880ce870 con 0x7f32880cb170 2023-08-10T10:29:14.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f328d46a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328815fa60 con 0x7f32880cc810 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f328d46a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880ccc20 con 0x7f32880cad90 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3286ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32880cad90 0x7f3288071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f32867fc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32880cb170 0x7f328806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37162/0 (socket says 172.21.15.161:37162) 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f32867fc700 1 -- 172.21.15.161:0/1624502652 learned_addr learned my addr 172.21.15.161:0/1624502652 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2814f610 con 0x7fcf280cf760 2023-08-10T10:29:14.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2814fbd0 con 0x7fcf280cf760 2023-08-10T10:29:14.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3286ffd700 1 -- 172.21.15.161:0/1624502652 >> v2:172.21.15.161:3300/0 conn(0x7f32880cc810 msgr2=0x7f328815f520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:14.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3286ffd700 1 --2- 172.21.15.161:0/1624502652 >> v2:172.21.15.161:3300/0 conn(0x7f32880cc810 0x7f328815f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3286ffd700 1 -- 172.21.15.161:0/1624502652 >> v1:172.21.15.161:6789/0 conn(0x7f32880cb170 legacy=0x7f328806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7fb2af366700 1 -- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81655a0 msgr2=0x7fb2a80cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7fb2af366700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81655a0 0x7fb2a80cae90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:14.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3285ffb700 1 -- 172.21.15.161:0/1624502652 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080948308 0 0) 0x7f32880ce870 con 0x7f32880cb170 2023-08-10T10:29:14.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.269+0000 7f3286ffd700 1 -- 172.21.15.161:0/1624502652 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328806b9e0 con 0x7f32880cad90 2023-08-10T10:29:14.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7fb2af366700 1 -- 172.21.15.161:0/2022721623 shutdown_connections 2023-08-10T10:29:14.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7fb2af366700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a81651c0 0x7fb2a8165d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7fb2af366700 1 --2- 172.21.15.161:0/2022721623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81655a0 0x7fb2a80cae90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7fb2af366700 1 -- 172.21.15.161:0/2022721623 >> 172.21.15.161:0/2022721623 conn(0x7fb2a80cec40 msgr2=0x7fb2a80cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7f58314e3700 1 -- start start 2023-08-10T10:29:14.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7f3286ffd700 1 --2- 172.21.15.161:0/1624502652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f3288071750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3288074190 tx=0x7f328000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b838da6b5836efbb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7fb2af366700 1 -- 172.21.15.161:0/2022721623 shutdown_connections 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7f3285ffb700 1 -- 172.21.15.161:0/1624502652 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328000e070 con 0x7f32880cad90 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7f3285ffb700 1 -- 172.21.15.161:0/1624502652 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328000bbd0 con 0x7f32880cad90 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.270+0000 7f3285ffb700 1 -- 172.21.15.161:0/1624502652 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280012430 con 0x7f32880cad90 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 -- 172.21.15.161:0/1624502652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 msgr2=0x7f3288071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 --2- 172.21.15.161:0/1624502652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f3288071750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3288074190 tx=0x7f328000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:14.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 -- 172.21.15.161:0/1624502652 shutdown_connections 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 --2- 172.21.15.161:0/1624502652 >> v2:172.21.15.161:3300/0 conn(0x7f32880cc810 0x7f328815f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 --2- 172.21.15.161:0/1624502652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f3288071750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 -- 172.21.15.161:0/1624502652 >> 172.21.15.161:0/1624502652 conn(0x7f32880cec40 msgr2=0x7f32880cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f58314e3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f58314e3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f582c0ca160 0x7f582c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f58314e3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0ac850 con 0x7f582c0c9290 2023-08-10T10:29:14.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f58314e3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0ad3d0 con 0x7f582c0ca160 2023-08-10T10:29:14.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f58314e3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c160b90 con 0x7f582c1607b0 2023-08-10T10:29:14.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7fb2af366700 1 -- 172.21.15.161:0/2022721623 wait complete. 2023-08-10T10:29:14.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 -- 172.21.15.161:0/1624502652 shutdown_connections 2023-08-10T10:29:14.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f328d46a700 1 -- 172.21.15.161:0/1624502652 wait complete. 2023-08-10T10:29:14.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf24021030 con 0x7fcf280cf760 2023-08-10T10:29:14.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.272+0000 7fcf1e7fc700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 0x7fcf0c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.272+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf2408a800 con 0x7fcf280cf760 2023-08-10T10:29:14.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.272+0000 7fcf2df1f700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 0x7fcf0c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.272+0000 7fcf2df1f700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 0x7fcf0c06d1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009930 tx=0x7fcf18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28072520 con 0x7fcf280cf760 2023-08-10T10:29:14.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45328/0 (socket says 172.21.15.161:45328) 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 -- 172.21.15.161:0/1011082880 learned_addr learned my addr 172.21.15.161:0/1011082880 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 -- 172.21.15.161:0/1011082880 >> v2:172.21.15.175:3300/0 conn(0x7f582c0ca160 msgr2=0x7f582c0cca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 --2- 172.21.15.161:0/1011082880 >> v2:172.21.15.175:3300/0 conn(0x7f582c0ca160 0x7f582c0cca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 -- 172.21.15.161:0/1011082880 >> v1:172.21.15.175:6789/0 conn(0x7f582c0c9290 legacy=0x7f582c0ad860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.271+0000 7f582affd700 1 -- 172.21.15.161:0/1011082880 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0acaa0 con 0x7f582c1607b0 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.272+0000 7f582affd700 1 --2- 172.21.15.161:0/1011082880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f581c0098f0 tx=0x7f581c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8d021b72d8777a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7f5829ffb700 1 -- 172.21.15.161:0/1011082880 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c004230 con 0x7f582c1607b0 2023-08-10T10:29:14.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7f5829ffb700 1 -- 172.21.15.161:0/1011082880 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c004390 con 0x7f582c1607b0 2023-08-10T10:29:14.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7f5829ffb700 1 -- 172.21.15.161:0/1011082880 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0036a0 con 0x7f582c1607b0 2023-08-10T10:29:14.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7fb2af366700 1 Processor -- start 2023-08-10T10:29:14.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7f328d46a700 1 Processor -- start 2023-08-10T10:29:14.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7fb2af366700 1 -- start start 2023-08-10T10:29:14.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 -- 172.21.15.161:0/1011082880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 msgr2=0x7f582c06fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 --2- 172.21.15.161:0/1011082880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f581c0098f0 tx=0x7f581c009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:14.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 -- 172.21.15.161:0/1011082880 shutdown_connections 2023-08-10T10:29:14.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 --2- 172.21.15.161:0/1011082880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c1607b0 0x7f582c06fc60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 --2- 172.21.15.161:0/1011082880 >> v2:172.21.15.175:3300/0 conn(0x7f582c0ca160 0x7f582c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f58314e3700 1 -- 172.21.15.161:0/1011082880 >> 172.21.15.161:0/1011082880 conn(0x7f582c0cec40 msgr2=0x7f582c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f1016e37700 1 Processor -- start 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 0x7fb2a81640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81651c0 0x7fb2a80aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 0x7fb2a815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a81fff00 con 0x7fb2a81655a0 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a81ffbf0 con 0x7fb2a81651c0 2023-08-10T10:29:14.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7fb2af366700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a8164f90 con 0x7fb2a806b9e0 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.273+0000 7f328d46a700 1 -- start start 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f32880ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32880cb170 0x7f3288149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ae460 con 0x7f32880cc810 2023-08-10T10:29:14.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ad850 con 0x7f32880cad90 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f328d46a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880adb30 con 0x7f32880cb170 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f32877fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f32877fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60162/0 (socket says 172.21.15.161:60162) 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 -- 172.21.15.161:0/1034891030 learned_addr learned my addr 172.21.15.161:0/1034891030 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ac901700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81651c0 0x7fb2a80aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad102700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 0x7fb2a81640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad102700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 0x7fb2a81640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45334/0 (socket says 172.21.15.161:45334) 2023-08-10T10:29:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad102700 1 -- 172.21.15.161:0/170297656 learned_addr learned my addr 172.21.15.161:0/170297656 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 0x7fb2a815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 -- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32880cb170 msgr2=0x7f3288149df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:29:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32880cb170 0x7f3288149df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 -- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 msgr2=0x7f32880ac3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:29:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f32880ac3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 -- 172.21.15.161:0/1034891030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009a70 con 0x7f32880cc810 2023-08-10T10:29:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f32877fe700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f327800b3f0 tx=0x7f327800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 -- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 msgr2=0x7fb2a81640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 0x7fb2a81640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 -- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81651c0 msgr2=0x7fb2a80aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81651c0 0x7fb2a80aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fb2ad903700 1 -- 172.21.15.161:0/170297656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40094a0 con 0x7fb2a81655a0 2023-08-10T10:29:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb2ad903700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 0x7fb2a815d130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb298007fd0 tx=0x7fb29800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278011830 con 0x7f32880cc810 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32780119b0 con 0x7f32880cc810 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278011d60 con 0x7f32880cc810 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32880ade10 con 0x7f32880cc810 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328814a330 con 0x7f32880cc810 2023-08-10T10:29:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f58314e3700 1 -- 172.21.15.161:0/1011082880 shutdown_connections 2023-08-10T10:29:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7f58314e3700 1 -- 172.21.15.161:0/1011082880 wait complete. 2023-08-10T10:29:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fd699778700 1 Processor -- start 2023-08-10T10:29:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.275+0000 7fd699778700 1 -- start start 2023-08-10T10:29:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fd699778700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694158fe0 0x7fd69406fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fd699778700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6940c5900 0x7fd6940c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd699778700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69406bb80 con 0x7fd6940cd700 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd699778700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940cdbc0 con 0x7fd6940c5900 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd699778700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69406be60 con 0x7fd694158fe0 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6940c5900 0x7fd6940c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6940c5900 0x7fd6940c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58978/0 (socket says 172.21.15.161:58978) 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 -- 172.21.15.161:0/2792592133 learned_addr learned my addr 172.21.15.161:0/2792592133 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.274+0000 7f1016e37700 1 -- start start 2023-08-10T10:29:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f1016e37700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10100c9340 0x7f10100c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f1016e37700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101006b9e0 con 0x7f10100ce420 2023-08-10T10:29:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f1016e37700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101013f580 con 0x7f1010156410 2023-08-10T10:29:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7f1016e37700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101006c010 con 0x7f10100c9340 2023-08-10T10:29:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298005d70 con 0x7fb2a81655a0 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800ce50 con 0x7fb2a81655a0 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980072f0 con 0x7fb2a81655a0 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a80af0b0 con 0x7fb2a81655a0 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.276+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a8161c00 con 0x7fb2a81655a0 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7f58314e3700 1 Processor -- start 2023-08-10T10:29:14.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7f58314e3700 1 -- start start 2023-08-10T10:29:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 -- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694158fe0 msgr2=0x7fd69406fc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:29:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 --2- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694158fe0 0x7fd69406fc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 -- 172.21.15.161:0/2792592133 >> v1:172.21.15.161:6789/0 conn(0x7fd6940cd700 legacy=0x7fd69406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7fd6927fc700 1 -- 172.21.15.161:0/2792592133 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69406c140 con 0x7fd6940c5900 2023-08-10T10:29:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7f1014bd3700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f10100ce420 0x7f101013eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37176/0 (socket says 172.21.15.161:37176) 2023-08-10T10:29:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7f1014bd3700 1 -- 172.21.15.161:0/2878101603 learned_addr learned my addr 172.21.15.161:0/2878101603 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.277+0000 7f100ffff700 1 --2- 172.21.15.161:0/2878101603 >> v2:172.21.15.161:3300/0 conn(0x7f10100c9340 0x7f10100c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100f7fe700 1 -- 172.21.15.161:0/2878101603 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790160629 0 0) 0x7f101006b9e0 con 0x7f10100ce420 2023-08-10T10:29:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100f7fe700 1 -- 172.21.15.161:0/2878101603 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff80035b0 con 0x7f10100ce420 2023-08-10T10:29:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7fd6927fc700 1 --2- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940c5900 0x7fd6940c9290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6840092e0 tx=0x7fd6840095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bb1c29437f6038d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 0x7f582c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f582c0ca160 0x7f582c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 0x7f582c0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c4050 con 0x7f582c0ca160 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c3180 con 0x7f582c1607b0 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f58314e3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c33d0 con 0x7f582c0c9290 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100ffff700 1 -- 172.21.15.161:0/2878101603 >> v1:172.21.15.175:6789/0 conn(0x7f1010156410 legacy=0x7f1010156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100ffff700 1 -- 172.21.15.161:0/2878101603 >> v1:172.21.15.161:6789/0 conn(0x7f10100ce420 legacy=0x7f101013eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100ffff700 1 -- 172.21.15.161:0/2878101603 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101013f860 con 0x7f10100c9340 2023-08-10T10:29:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7f100ffff700 1 --2- 172.21.15.161:0/2878101603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100c9340 0x7f10100c97c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f100800be90 tx=0x7f100800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f208cf287c4639 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.278+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb298007450 con 0x7fb2a81655a0 2023-08-10T10:29:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 0x7f582c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 0x7f582c0b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45352/0 (socket says 172.21.15.161:45352) 2023-08-10T10:29:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582affd700 1 -- 172.21.15.161:0/89047886 learned_addr learned my addr 172.21.15.161:0/89047886 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 0x7f582c0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7fb29dffb700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 0x7fb28c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb298088500 con 0x7fb2a81655a0 2023-08-10T10:29:14.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582a7fc700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f582c0ca160 0x7f582c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 -- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 msgr2=0x7f582c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 0x7f582c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 -- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f582c0ca160 msgr2=0x7f582c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f582c0ca160 0x7f582c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f57241b7700 1 Processor -- start 2023-08-10T10:29:14.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 -- 172.21.15.161:0/89047886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009550 con 0x7f582c1607b0 2023-08-10T10:29:14.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7fb2ad102700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 0x7fb28c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f582b7fe700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 0x7f582c0b4260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f582400be20 tx=0x7f5824009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f100f7fe700 1 -- 172.21.15.161:0/2878101603 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008010070 con 0x7f10100c9340 2023-08-10T10:29:14.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f100f7fe700 1 -- 172.21.15.161:0/2878101603 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008003a20 con 0x7f10100c9340 2023-08-10T10:29:14.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f100f7fe700 1 -- 172.21.15.161:0/2878101603 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008003db0 con 0x7f10100c9340 2023-08-10T10:29:14.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fb2ad102700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 0x7fb28c06d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0003c50 tx=0x7fb2a0009970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fd691ffb700 1 -- 172.21.15.161:0/2792592133 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684004230 con 0x7fd6940c5900 2023-08-10T10:29:14.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fd691ffb700 1 -- 172.21.15.161:0/2792592133 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd684004390 con 0x7fd6940c5900 2023-08-10T10:29:14.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f327801a400 con 0x7f32880cc810 2023-08-10T10:29:14.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7f1016e37700 1 -- 172.21.15.161:0/2878101603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100c9340 msgr2=0x7f10100c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7f1016e37700 1 --2- 172.21.15.161:0/2878101603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100c9340 0x7f10100c97c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f100800be90 tx=0x7f100800d330 comp rx=0 tx=0).stop 2023-08-10T10:29:14.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf240558a0 con 0x7fcf280cf760 2023-08-10T10:29:14.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fd691ffb700 1 -- 172.21.15.161:0/2792592133 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400c770 con 0x7fd6940c5900 2023-08-10T10:29:14.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fd699778700 1 -- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940c5900 msgr2=0x7fd6940c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.280+0000 7fd699778700 1 --2- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940c5900 0x7fd6940c9290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6840092e0 tx=0x7fd6840095f0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f1016e37700 1 -- 172.21.15.161:0/2878101603 shutdown_connections 2023-08-10T10:29:14.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f1016e37700 1 --2- 172.21.15.161:0/2878101603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10100c9340 0x7f10100c97c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f1016e37700 1 -- 172.21.15.161:0/2878101603 >> 172.21.15.161:0/2878101603 conn(0x7f10100cec40 msgr2=0x7f10100cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f326f7fe700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 0x7f327406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3278089440 con 0x7f32880cc810 2023-08-10T10:29:14.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f1016e37700 1 -- 172.21.15.161:0/2878101603 shutdown_connections 2023-08-10T10:29:14.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f1016e37700 1 -- 172.21.15.161:0/2878101603 wait complete. 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.279+0000 7f57241b7700 1 -- start start 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f57241b7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f571c0c9340 0x7f571c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f57241b7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 0x7f571c156880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f57241b7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c06b9e0 con 0x7f571c0ce420 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f57241b7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c06c010 con 0x7f571c156410 2023-08-10T10:29:14.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f57241b7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0c9d00 con 0x7f571c0c9340 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5722754700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 0x7f571c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f571c0c9340 0x7f571c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f571c0c9340 0x7f571c0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:58992/0 (socket says 172.21.15.161:58992) 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 -- 172.21.15.161:0/3691656954 learned_addr learned my addr 172.21.15.161:0/3691656954 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5722754700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 0x7f571c156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60190/0 (socket says 172.21.15.161:60190) 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 -- 172.21.15.161:0/3691656954 >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 msgr2=0x7f571c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 --2- 172.21.15.161:0/3691656954 >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 0x7f571c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 -- 172.21.15.161:0/3691656954 >> v1:172.21.15.161:6789/0 conn(0x7f571c0ce420 legacy=0x7f571c13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 -- 172.21.15.161:0/3691656954 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c13f580 con 0x7f571c0c9340 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.281+0000 7f5721752700 1 --2- 172.21.15.161:0/3691656954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0c9340 0x7f571c0c97c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cb620 tx=0x7f5718007b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f4d7e44b43c59c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.282+0000 7f5720f51700 1 -- 172.21.15.161:0/3691656954 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718010070 con 0x7f571c0c9340 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.282+0000 7f5720f51700 1 -- 172.21.15.161:0/3691656954 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571800b780 con 0x7f571c0c9340 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.282+0000 7f5720f51700 1 -- 172.21.15.161:0/3691656954 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800bb10 con 0x7f571c0c9340 2023-08-10T10:29:14.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.282+0000 7f1016e37700 1 Processor -- start 2023-08-10T10:29:14.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.282+0000 7f1016e37700 1 -- start start 2023-08-10T10:29:14.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 -- 172.21.15.161:0/3691656954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0c9340 msgr2=0x7f571c0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 --2- 172.21.15.161:0/3691656954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0c9340 0x7f571c0c97c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cb620 tx=0x7f5718007b90 comp rx=0 tx=0).stop 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 -- 172.21.15.161:0/3691656954 shutdown_connections 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 --2- 172.21.15.161:0/3691656954 >> v2:172.21.15.161:3300/0 conn(0x7f571c156410 0x7f571c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 --2- 172.21.15.161:0/3691656954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0c9340 0x7f571c0c97c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 -- 172.21.15.161:0/3691656954 >> 172.21.15.161:0/3691656954 conn(0x7f571c0cec40 msgr2=0x7f571c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 -- 172.21.15.161:0/3691656954 shutdown_connections 2023-08-10T10:29:14.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f57241b7700 1 -- 172.21.15.161:0/3691656954 wait complete. 2023-08-10T10:29:14.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10100c9340 0x7f10101552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10100ce420 0x7f10100c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101015b770 con 0x7f1010156410 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100708e0 con 0x7f10100c9340 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f1016e37700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010070320 con 0x7f10100ce420 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f10153d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f10153d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60198/0 (socket says 172.21.15.161:60198) 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.283+0000 7f10153d4700 1 -- 172.21.15.161:0/65148741 learned_addr learned my addr 172.21.15.161:0/65148741 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7fd699778700 1 -- 172.21.15.161:0/2792592133 shutdown_connections 2023-08-10T10:29:14.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7fd699778700 1 --2- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694158fe0 0x7fd69406fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7fd699778700 1 --2- 172.21.15.161:0/2792592133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940c5900 0x7fd6940c9290 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7fd699778700 1 -- 172.21.15.161:0/2792592133 >> 172.21.15.161:0/2792592133 conn(0x7fd6940cec40 msgr2=0x7fd6940cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f1014bd3700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10100c9340 0x7f10101552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 -- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10100ce420 msgr2=0x7f10100c88d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:29:14.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10100ce420 0x7f10100c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 -- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10100c9340 msgr2=0x7f10101552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10100c9340 0x7f10101552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 -- 172.21.15.161:0/65148741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100800bb70 con 0x7f1010156410 2023-08-10T10:29:14.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32680052f0 con 0x7f32880cc810 2023-08-10T10:29:14.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400cbb0 con 0x7f582c1607b0 2023-08-10T10:29:14.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582400cd50 con 0x7f582c1607b0 2023-08-10T10:29:14.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824014680 con 0x7f582c1607b0 2023-08-10T10:29:14.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0c36b0 con 0x7f582c1607b0 2023-08-10T10:29:14.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f10153d4700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f100000b410 tx=0x7f100000b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.284+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0c3c70 con 0x7f582c1607b0 2023-08-10T10:29:14.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.285+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a80af0b0 con 0x7fb2a81655a0 2023-08-10T10:29:14.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f3286ffd700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 0x7f327406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f3286ffd700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 0x7f327406d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3280014040 tx=0x7f3280011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.285+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080052f0 con 0x7f582c1607b0 2023-08-10T10:29:14.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f582401c360 con 0x7f582c1607b0 2023-08-10T10:29:14.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f581b7fe700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 0x7f581006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f582affd700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 0x7f581006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5824089370 con 0x7f582c1607b0 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.288+0000 7f582affd700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 0x7f581006d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.291+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5824054500 con 0x7f582c1607b0 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7fd699778700 1 -- 172.21.15.161:0/2792592133 shutdown_connections 2023-08-10T10:29:14.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.292+0000 7fd699778700 1 -- 172.21.15.161:0/2792592133 wait complete. 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.285+0000 7f57241b7700 1 Processor -- start 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.285+0000 7f57241b7700 1 -- start start 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 0x7f571c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0ce420 0x7f571c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c155c60 con 0x7f571c156410 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0c6c60 con 0x7f571c0ce420 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f57241b7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c13d5e0 con 0x7f571c0c9340 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f5722754700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f5721f53700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 0x7f571c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f5722754700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60206/0 (socket says 172.21.15.161:60206) 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.286+0000 7f5722754700 1 -- 172.21.15.161:0/1871462654 learned_addr learned my addr 172.21.15.161:0/1871462654 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 -- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 msgr2=0x7f571c154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 0x7f571c154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 -- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0ce420 msgr2=0x7f571c0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0ce420 0x7f571c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 -- 172.21.15.161:0/1871462654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718007590 con 0x7f571c156410 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5721f53700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 0x7f571c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.287+0000 7f5722754700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f570c00e7d0 tx=0x7f570c00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.292+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f32780544e0 con 0x7f32880cc810 2023-08-10T10:29:14.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.293+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000011830 con 0x7f1010156410 2023-08-10T10:29:14.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.293+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1010070600 con 0x7f1010156410 2023-08-10T10:29:14.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.293+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010155a70 con 0x7f1010156410 2023-08-10T10:29:14.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.294+0000 7fd699778700 1 Processor -- start 2023-08-10T10:29:14.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.294+0000 7fd699778700 1 -- start start 2023-08-10T10:29:14.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.295+0000 7fd699778700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd699778700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd694158fe0 0x7fd694153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd699778700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694151e50 0x7fd6940b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd699778700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694155d40 con 0x7fd694158fe0 2023-08-10T10:29:14.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd699778700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694154510 con 0x7fd6940cd700 2023-08-10T10:29:14.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd699778700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd694155370 con 0x7fd694151e50 2023-08-10T10:29:14.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7f7a895ff700 1 Processor -- start 2023-08-10T10:29:14.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59012/0 (socket says 172.21.15.161:59012) 2023-08-10T10:29:14.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd692ffd700 1 -- 172.21.15.161:0/2368935477 learned_addr learned my addr 172.21.15.161:0/2368935477 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7fd6937fe700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694151e50 0x7fd6940b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c013680 con 0x7f571c156410 2023-08-10T10:29:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c13c9d0 con 0x7f571c156410 2023-08-10T10:29:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c13cf90 con 0x7f571c156410 2023-08-10T10:29:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 -- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694151e50 msgr2=0x7fd6940b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694151e50 0x7fd6940b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 -- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd694158fe0 msgr2=0x7fd694153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd694158fe0 0x7fd694153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 -- 172.21.15.161:0/2368935477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009de0 con 0x7fd6940cd700 2023-08-10T10:29:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd692ffd700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d940 tx=0x7fd68800dc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c072520 con 0x7f571c156410 2023-08-10T10:29:14.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012970 con 0x7fd6940cd700 2023-08-10T10:29:14.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688012ad0 con 0x7fd6940cd700 2023-08-10T10:29:14.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.297+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012e60 con 0x7fd6940cd700 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.296+0000 7f7a895ff700 1 -- start start 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a841618e0 0x7f7a840cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a840c24e0 0x7f7a840ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840cf160 con 0x7f7a840c24e0 2023-08-10T10:29:14.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a84161cc0 con 0x7f7a841618e0 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a895ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840cd6a0 con 0x7f7a840cecd0 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45386/0 (socket says 172.21.15.161:45386) 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 -- 172.21.15.161:0/3167589815 learned_addr learned my addr 172.21.15.161:0/3167589815 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a827fc700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.161:3300/0 conn(0x7f7a840c24e0 0x7f7a840ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000011990 con 0x7f1010156410 2023-08-10T10:29:14.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000011d00 con 0x7f1010156410 2023-08-10T10:29:14.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a82ffd700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.175:3300/0 conn(0x7f7a841618e0 0x7f7a840cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 -- 172.21.15.161:0/3167589815 >> v2:172.21.15.175:3300/0 conn(0x7f7a841618e0 msgr2=0x7f7a840cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.175:3300/0 conn(0x7f7a841618e0 0x7f7a840cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 -- 172.21.15.161:0/3167589815 >> v2:172.21.15.161:3300/0 conn(0x7f7a840c24e0 msgr2=0x7f7a840ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.161:3300/0 conn(0x7f7a840c24e0 0x7f7a840ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7f7a837fe700 1 -- 172.21.15.161:0/3167589815 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840cd980 con 0x7f7a840cecd0 2023-08-10T10:29:14.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.298+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd694154760 con 0x7fd6940cd700 2023-08-10T10:29:14.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.299+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd694154d20 con 0x7fd6940cd700 2023-08-10T10:29:14.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.299+0000 7f7a837fe700 1 --2- 172.21.15.161:0/3167589815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406d8c0 tx=0x7f7a7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b06b78cdfe6136 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.300+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd694155650 con 0x7fd6940cd700 2023-08-10T10:29:14.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7f7a81ffb700 1 -- 172.21.15.161:0/3167589815 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00e070 con 0x7f7a840cecd0 2023-08-10T10:29:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7f7a81ffb700 1 -- 172.21.15.161:0/3167589815 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00b8d0 con 0x7f7a840cecd0 2023-08-10T10:29:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7f7a81ffb700 1 -- 172.21.15.161:0/3167589815 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00bc80 con 0x7f7a840cecd0 2023-08-10T10:29:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd688007570 con 0x7fd6940cd700 2023-08-10T10:29:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7fd6837fe700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 0x7fd67806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd68808d180 con 0x7fd6940cd700 2023-08-10T10:29:14.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.301+0000 7fd6927fc700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 0x7fd67806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f7a895ff700 1 -- 172.21.15.161:0/3167589815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 msgr2=0x7f7a841652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f7a895ff700 1 --2- 172.21.15.161:0/3167589815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406d8c0 tx=0x7f7a7c00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:14.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7fd6927fc700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 0x7fd67806d170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6840092e0 tx=0x7fd684011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1000004020 con 0x7f1010156410 2023-08-10T10:29:14.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f100d7fa700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 0x7f0ffc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c005a20 con 0x7f571c156410 2023-08-10T10:29:14.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c005d90 con 0x7f571c156410 2023-08-10T10:29:14.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1000089180 con 0x7f1010156410 2023-08-10T10:29:14.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.302+0000 7f1014bd3700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 0x7f0ffc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.303+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff00052f0 con 0x7f1010156410 2023-08-10T10:29:14.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.303+0000 7f1014bd3700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 0x7f0ffc06d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1004004a00 tx=0x7f100400b2a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.303+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f570c0137e0 con 0x7f571c156410 2023-08-10T10:29:14.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 -- 172.21.15.161:0/3167589815 shutdown_connections 2023-08-10T10:29:14.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 --2- 172.21.15.161:0/3167589815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a840cecd0 0x7f7a841652c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.175:3300/0 conn(0x7f7a841618e0 0x7f7a840cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 --2- 172.21.15.161:0/3167589815 >> v2:172.21.15.161:3300/0 conn(0x7f7a840c24e0 0x7f7a840ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 -- 172.21.15.161:0/3167589815 >> 172.21.15.161:0/3167589815 conn(0x7f7a840cf450 msgr2=0x7f7a840cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 -- 172.21.15.161:0/3167589815 shutdown_connections 2023-08-10T10:29:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f7a895ff700 1 -- 172.21.15.161:0/3167589815 wait complete. 2023-08-10T10:29:14.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f57127fc700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 0x7f570006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f570c089bb0 con 0x7f571c156410 2023-08-10T10:29:14.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.304+0000 7f5721f53700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 0x7f570006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.305+0000 7f5721f53700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 0x7f570006d1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5714002230 tx=0x7f5714009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.306+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd6880581a0 con 0x7fd6940cd700 2023-08-10T10:29:14.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.306+0000 7f7a895ff700 1 Processor -- start 2023-08-10T10:29:14.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.306+0000 7f7a895ff700 1 -- start start 2023-08-10T10:29:14.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb2a80af0b0 con 0x7fb2a81655a0 2023-08-10T10:29:14.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840c24e0 0x7f7a840c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a840cecd0 0x7f7a840c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840c8c50 con 0x7f7a840c24e0 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84150ee0 con 0x7f7a840cecd0 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a895ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a841511c0 con 0x7f7a841618e0 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a837fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a837fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45398/0 (socket says 172.21.15.161:45398) 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.307+0000 7f7a837fe700 1 -- 172.21.15.161:0/1026421449 learned_addr learned my addr 172.21.15.161:0/1026421449 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 -- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a840cecd0 msgr2=0x7f7a840c8710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a840cecd0 0x7f7a840c8710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 -- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840c24e0 msgr2=0x7f7a840c90f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840c24e0 0x7f7a840c90f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 -- 172.21.15.161:0/1026421449 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009b30 con 0x7f7a841618e0 2023-08-10T10:29:14.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a837fe700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00b680 tx=0x7f7a7c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0092e0 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c004250 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0045e0 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a841514a0 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.308+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84154090 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.310+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a7c004740 con 0x7f7a841618e0 2023-08-10T10:29:14.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.311+0000 7f7a737fe700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 0x7f7a6806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.311+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a7c08a950 con 0x7f7a841618e0 2023-08-10T10:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.311+0000 7f7a82ffd700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 0x7f7a6806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.312+0000 7f7a82ffd700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 0x7f7a6806d170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7a740099d0 tx=0x7f7a74009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.315+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a84072860 con 0x7f7a841618e0 2023-08-10T10:29:14.360 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.315+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f570c058660 con 0x7f571c156410 2023-08-10T10:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.319+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10000541c0 con 0x7f1010156410 2023-08-10T10:29:14.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.320+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a7c055ab0 con 0x7f7a841618e0 2023-08-10T10:29:14.688 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.682+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf2814fdf0 con 0x7fcf280cf760 2023-08-10T10:29:14.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.686+0000 7fcf1e7fc700 1 -- 172.21.15.161:0/3994818270 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf24015070 con 0x7fcf280cf760 2023-08-10T10:29:14.689 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.682+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f32680055a0 con 0x7f32880cc810 2023-08-10T10:29:14.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.682+0000 7f326f7fe700 1 -- 172.21.15.161:0/1034891030 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3278015030 con 0x7f32880cc810 2023-08-10T10:29:14.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.687+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 msgr2=0x7f327406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.687+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 0x7f327406d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3280014040 tx=0x7f3280011000 comp rx=0 tx=0).stop 2023-08-10T10:29:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.687+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 msgr2=0x7f32880a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.687+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f327800b3f0 tx=0x7f327800b7b0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5808005870 con 0x7f582c1607b0 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 shutdown_connections 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f327406ace0 0x7f327406d1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32880cc810 0x7f32880a8440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32880cad90 0x7f32880ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 --2- 172.21.15.161:0/1034891030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32880cb170 0x7f3288149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.688+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 >> 172.21.15.161:0/1034891030 conn(0x7f32880cec40 msgr2=0x7f32880b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.689+0000 7f581b7fe700 1 -- 172.21.15.161:0/89047886 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5824019090 con 0x7f582c1607b0 2023-08-10T10:29:14.692 INFO:teuthology.orchestra.run.smithi161.stdout:55834574858 2023-08-10T10:29:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.689+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 shutdown_connections 2023-08-10T10:29:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.689+0000 7f328d46a700 1 -- 172.21.15.161:0/1034891030 wait complete. 2023-08-10T10:29:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.692+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 msgr2=0x7fcf0c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.692+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 0x7fcf0c06d1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009930 tx=0x7fcf18008040 comp rx=0 tx=0).stop 2023-08-10T10:29:14.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.692+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 msgr2=0x7fcf2814e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.692+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009c40 tx=0x7fcf24004750 comp rx=0 tx=0).stop 2023-08-10T10:29:14.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 shutdown_connections 2023-08-10T10:29:14.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 msgr2=0x7f581006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 0x7f581006d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c008030 comp rx=0 tx=0).stop 2023-08-10T10:29:14.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 msgr2=0x7f582c0b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 0x7f582c0b4260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f582400be20 tx=0x7f5824009ef0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fcf0c06ad30 0x7fcf0c06d1f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf2813f020 0x7fcf2814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf280ce420 0x7fcf280c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 --2- 172.21.15.161:0/3994818270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf280cf760 0x7fcf2814e440 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 >> 172.21.15.161:0/3994818270 conn(0x7fcf280cec40 msgr2=0x7fcf28070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.693+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 shutdown_connections 2023-08-10T10:29:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7fcf30183700 1 -- 172.21.15.161:0/3994818270 wait complete. 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 shutdown_connections 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f581006ad00 0x7f581006d1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c1607b0 0x7f582c0b4260 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0c9290 0x7f582c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 --2- 172.21.15.161:0/89047886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f582c0ca160 0x7f582c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.694+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 >> 172.21.15.161:0/89047886 conn(0x7f582c0cec40 msgr2=0x7f582c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.695+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 shutdown_connections 2023-08-10T10:29:14.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.695+0000 7f58314e3700 1 -- 172.21.15.161:0/89047886 wait complete. 2023-08-10T10:29:14.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.700+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2a8200040 con 0x7fb2a81655a0 2023-08-10T10:29:14.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.706+0000 7fb29dffb700 1 -- 172.21.15.161:0/170297656 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2a8200040 con 0x7fb2a81655a0 2023-08-10T10:29:14.707 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2023-08-10T10:29:14.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-08-10T10:29:14.709 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 msgr2=0x7fb28c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 0x7fb28c06d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0003c50 tx=0x7fb2a0009970 comp rx=0 tx=0).stop 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 msgr2=0x7fb2a815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 0x7fb2a815d130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb298007fd0 tx=0x7fb29800c6e0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 shutdown_connections 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb28c06ad30 0x7fb28c06d1f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a81655a0 0x7fb2a815d130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.708+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a806b9e0 0x7fb2a81640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.709+0000 7fb2af366700 1 --2- 172.21.15.161:0/170297656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a81651c0 0x7fb2a80aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.709+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 >> 172.21.15.161:0/170297656 conn(0x7fb2a80cec40 msgr2=0x7fb2a80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.709+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 shutdown_connections 2023-08-10T10:29:14.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.709+0000 7fb2af366700 1 -- 172.21.15.161:0/170297656 wait complete. 2023-08-10T10:29:14.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-08-10T10:29:14.717 INFO:teuthology.orchestra.run.smithi161.stdout:55834574858 2023-08-10T10:29:14.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.713+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6940744e0 con 0x7fd6940cd700 2023-08-10T10:29:14.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.714+0000 7fd6837fe700 1 -- 172.21.15.161:0/2368935477 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd688020090 con 0x7fd6940cd700 2023-08-10T10:29:14.717 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.716+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f571c13d750 con 0x7f571c156410 2023-08-10T10:29:14.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.717+0000 7f57127fc700 1 -- 172.21.15.161:0/1871462654 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f570c021090 con 0x7f571c156410 2023-08-10T10:29:14.719 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.717+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 msgr2=0x7fd67806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.717+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 0x7fd67806d170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6840092e0 tx=0x7fd684011000 comp rx=0 tx=0).stop 2023-08-10T10:29:14.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.717+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 msgr2=0x7fd694155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.718+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d940 tx=0x7fd68800dc50 comp rx=0 tx=0).stop 2023-08-10T10:29:14.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 shutdown_connections 2023-08-10T10:29:14.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd67806acb0 0x7fd67806d170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd694151e50 0x7fd6940b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6940cd700 0x7fd694155800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 --2- 172.21.15.161:0/2368935477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd694158fe0 0x7fd694153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 >> 172.21.15.161:0/2368935477 conn(0x7fd6940cec40 msgr2=0x7fd694158200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7a840744e0 con 0x7f7a841618e0 2023-08-10T10:29:14.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 shutdown_connections 2023-08-10T10:29:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7fd699778700 1 -- 172.21.15.161:0/2368935477 wait complete. 2023-08-10T10:29:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 msgr2=0x7f570006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 0x7f570006d1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5714002230 tx=0x7f5714009040 comp rx=0 tx=0).stop 2023-08-10T10:29:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 msgr2=0x7f571c0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.719+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f570c00e7d0 tx=0x7f570c00eae0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.720+0000 7f7a737fe700 1 -- 172.21.15.161:0/1026421449 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a7c020020 con 0x7f7a841618e0 2023-08-10T10:29:14.723 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 shutdown_connections 2023-08-10T10:29:14.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f570006ad10 0x7f570006d1d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571c156410 0x7f571c0c7510 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f571c0c9340 0x7f571c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 --2- 172.21.15.161:0/1871462654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f571c0ce420 0x7f571c0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 >> 172.21.15.161:0/1871462654 conn(0x7f571c0cec40 msgr2=0x7f571c06fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 shutdown_connections 2023-08-10T10:29:14.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f57241b7700 1 -- 172.21.15.161:0/1871462654 wait complete. 2023-08-10T10:29:14.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-08-10T10:29:14.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.723+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0ff0005870 con 0x7f1010156410 2023-08-10T10:29:14.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.724+0000 7f100d7fa700 1 -- 172.21.15.161:0/65148741 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1000011e60 con 0x7f1010156410 2023-08-10T10:29:14.727 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.727 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 msgr2=0x7f7a6806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 0x7f7a6806d170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7a740099d0 tx=0x7f7a74009210 comp rx=0 tx=0).stop 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 msgr2=0x7f7a84153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00b680 tx=0x7f7a7c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 shutdown_connections 2023-08-10T10:29:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a6806acb0 0x7f7a6806d170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a841618e0 0x7f7a84153b50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840c24e0 0x7f7a840c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 --2- 172.21.15.161:0/1026421449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a840cecd0 0x7f7a840c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 >> 172.21.15.161:0/1026421449 conn(0x7f7a840cf450 msgr2=0x7f7a84071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 shutdown_connections 2023-08-10T10:29:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.725+0000 7f7a895ff700 1 -- 172.21.15.161:0/1026421449 wait complete. 2023-08-10T10:29:14.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.727+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 msgr2=0x7f0ffc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.727+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 0x7f0ffc06d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1004004a00 tx=0x7f100400b2a0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.727+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 msgr2=0x7f101015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.727+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f100000b410 tx=0x7f100000b7d0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 shutdown_connections 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0ffc06ace0 0x7f0ffc06d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010156410 0x7f101015bc00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10100c9340 0x7f10101552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 --2- 172.21.15.161:0/65148741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10100ce420 0x7f10100c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 >> 172.21.15.161:0/65148741 conn(0x7f10100cec40 msgr2=0x7f10100aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 shutdown_connections 2023-08-10T10:29:14.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.728+0000 7f1016e37700 1 -- 172.21.15.161:0/65148741 wait complete. 2023-08-10T10:29:14.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-08-10T10:29:14.733 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-08-10T10:29:14.744 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-08-10T10:29:14.746 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-08-10T10:29:14.747 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-08-10T10:29:14.747 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:14.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-10T10:29:14.748 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:14.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.905+0000 7f63338b0700 1 Processor -- start 2023-08-10T10:29:14.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.905+0000 7f63338b0700 1 -- start start 2023-08-10T10:29:14.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f63338b0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f63338b0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f632c071940 0x7f632c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f63338b0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c0cf6a0 con 0x7f632c06a190 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f63338b0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c06eb80 con 0x7f632c071940 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f63338b0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0af510 con 0x7f632c0aea70 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f633164c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f632c06a190 0x7f632c06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37238/0 (socket says 172.21.15.161:37238) 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f633164c700 1 -- 172.21.15.161:0/1349165835 learned_addr learned my addr 172.21.15.161:0/1349165835 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 --2- 172.21.15.161:0/1349165835 >> v2:172.21.15.161:3300/0 conn(0x7f632c071940 0x7f632c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6330e4b700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 -- 172.21.15.161:0/1349165835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 msgr2=0x7f632c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 -- 172.21.15.161:0/1349165835 >> v1:172.21.15.161:6789/0 conn(0x7f632c06a190 legacy=0x7f632c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 -- 172.21.15.161:0/1349165835 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c06ae60 con 0x7f632c071940 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6323fff700 1 -- 172.21.15.161:0/1349165835 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90184513 0 0) 0x7f632c0cf6a0 con 0x7f632c06a190 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6331e4d700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c06a570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d90 tx=0x7f632400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddec4fe013441e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6323fff700 1 -- 172.21.15.161:0/1349165835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632400e070 con 0x7f632c071940 2023-08-10T10:29:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6323fff700 1 -- 172.21.15.161:0/1349165835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632400bbd0 con 0x7f632c071940 2023-08-10T10:29:14.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.906+0000 7f6323fff700 1 -- 172.21.15.161:0/1349165835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324012430 con 0x7f632c071940 2023-08-10T10:29:14.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 -- 172.21.15.161:0/1349165835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 msgr2=0x7f632c06a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c06a570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d90 tx=0x7f632400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:14.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 -- 172.21.15.161:0/1349165835 shutdown_connections 2023-08-10T10:29:14.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c06a570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 --2- 172.21.15.161:0/1349165835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 -- 172.21.15.161:0/1349165835 >> 172.21.15.161:0/1349165835 conn(0x7f632c0cfd70 msgr2=0x7f632c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 -- 172.21.15.161:0/1349165835 shutdown_connections 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.907+0000 7f63338b0700 1 -- 172.21.15.161:0/1349165835 wait complete. 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.908+0000 7f63338b0700 1 Processor -- start 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.908+0000 7f63338b0700 1 -- start start 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632c06a190 0x7f632c14a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c1f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c158fa0 con 0x7f632c071940 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1f2be0 con 0x7f632c06a190 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f63338b0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1f68f0 con 0x7f632c0aea70 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60240/0 (socket says 172.21.15.161:60240) 2023-08-10T10:29:14.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 -- 172.21.15.161:0/296454735 learned_addr learned my addr 172.21.15.161:0/296454735 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f633164c700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632c06a190 0x7f632c14a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6331e4d700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c1f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 -- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 msgr2=0x7f632c1f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c1f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 -- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632c06a190 msgr2=0x7f632c14a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632c06a190 0x7f632c14a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 -- 172.21.15.161:0/296454735 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324009a70 con 0x7f632c071940 2023-08-10T10:29:14.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.909+0000 7f6330e4b700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f632800e810 tx=0x7f632800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.910+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800c070 con 0x7f632c071940 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.910+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6328013610 con 0x7f632c071940 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.910+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c1f6610 con 0x7f632c071940 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.910+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280139a0 con 0x7f632c071940 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.910+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c1f2870 con 0x7f632c071940 2023-08-10T10:29:14.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.911+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c1f2a30 con 0x7f632c071940 2023-08-10T10:29:14.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.911+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6328013b00 con 0x7f632c071940 2023-08-10T10:29:14.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.911+0000 7f6321ffb700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 0x7f631006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:14.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.912+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6328088e50 con 0x7f632c071940 2023-08-10T10:29:14.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.912+0000 7f633164c700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 0x7f631006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:14.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.912+0000 7f633164c700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 0x7f631006d1d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f60 tx=0x7f631c007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:14.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:14.916+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6328057990 con 0x7f632c071940 2023-08-10T10:29:15.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.096+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f632c15d520 con 0x7f631006ad10 2023-08-10T10:29:15.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.104+0000 7f6321ffb700 1 -- 172.21.15.161:0/296454735 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286680 (secure 0 0 0) 0x7f631c001290 con 0x7f631006ad10 2023-08-10T10:29:15.108 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 msgr2=0x7f631006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 0x7f631006d1d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f60 tx=0x7f631c007e70 comp rx=0 tx=0).stop 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 msgr2=0x7f632c1f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f632800e810 tx=0x7f632800eb20 comp rx=0 tx=0).stop 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 shutdown_connections 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f631006ad10 0x7f631006d1d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f632c0aea70 0x7f632c1f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632c06a190 0x7f632c14a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 --2- 172.21.15.161:0/296454735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f632c071940 0x7f632c1f5a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 >> 172.21.15.161:0/296454735 conn(0x7f632c0cfd70 msgr2=0x7f632c15c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 shutdown_connections 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.108+0000 7f63338b0700 1 -- 172.21.15.161:0/296454735 wait complete. 2023-08-10T10:29:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:15.121 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-10T10:29:14.189300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002417"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344646+0000","last_change":"2023-08-10T10:29:03.450108+0000","last_active":"2023-08-10T10:29:06.344646+0000","last_peered":"2023-08-10T10:29:06.344646+0000","last_clean":"2023-08-10T10:29:06.344646+0000","last_became_active":"2023-08-10T10:29:03.449434+0000","last_became_peered":"2023-08-10T10:29:03.449434+0000","last_unstale":"2023-08-10T10:29:06.344646+0000","last_undegraded":"2023-08-10T10:29:06.344646+0000","last_fullsized":"2023-08-10T10:29:06.344646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:03.644957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435719+0000","last_change":"2023-08-10T10:29:03.449144+0000","last_active":"2023-08-10T10:29:04.435719+0000","last_peered":"2023-08-10T10:29:04.435719+0000","last_clean":"2023-08-10T10:29:04.435719+0000","last_became_active":"2023-08-10T10:29:03.448690+0000","last_became_peered":"2023-08-10T10:29:03.448690+0000","last_unstale":"2023-08-10T10:29:04.435719+0000","last_undegraded":"2023-08-10T10:29:04.435719+0000","last_fullsized":"2023-08-10T10:29:04.435719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564510+0000","last_change":"2023-08-10T10:29:03.448973+0000","last_active":"2023-08-10T10:29:06.564510+0000","last_peered":"2023-08-10T10:29:06.564510+0000","last_clean":"2023-08-10T10:29:06.564510+0000","last_became_active":"2023-08-10T10:29:03.448666+0000","last_became_peered":"2023-08-10T10:29:03.448666+0000","last_unstale":"2023-08-10T10:29:06.564510+0000","last_undegraded":"2023-08-10T10:29:06.564510+0000","last_fullsized":"2023-08-10T10:29:06.564510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:38.594843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.795980+0000","last_change":"2023-08-10T10:29:03.451710+0000","last_active":"2023-08-10T10:29:04.795980+0000","last_peered":"2023-08-10T10:29:04.795980+0000","last_clean":"2023-08-10T10:29:04.795980+0000","last_became_active":"2023-08-10T10:29:03.451411+0000","last_became_peered":"2023-08-10T10:29:03.451411+0000","last_unstale":"2023-08-10T10:29:04.795980+0000","last_undegraded":"2023-08-10T10:29:04.795980+0000","last_fullsized":"2023-08-10T10:29:04.795980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435794+0000","last_change":"2023-08-10T10:29:03.451672+0000","last_active":"2023-08-10T10:29:04.435794+0000","last_peered":"2023-08-10T10:29:04.435794+0000","last_clean":"2023-08-10T10:29:04.435794+0000","last_became_active":"2023-08-10T10:29:03.451376+0000","last_became_peered":"2023-08-10T10:29:03.451376+0000","last_unstale":"2023-08-10T10:29:04.435794+0000","last_undegraded":"2023-08-10T10:29:04.435794+0000","last_fullsized":"2023-08-10T10:29:04.435794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440823+0000","last_change":"2023-08-10T10:29:03.444231+0000","last_active":"2023-08-10T10:29:04.440823+0000","last_peered":"2023-08-10T10:29:04.440823+0000","last_clean":"2023-08-10T10:29:04.440823+0000","last_became_active":"2023-08-10T10:29:03.443264+0000","last_became_peered":"2023-08-10T10:29:03.443264+0000","last_unstale":"2023-08-10T10:29:04.440823+0000","last_undegraded":"2023-08-10T10:29:04.440823+0000","last_fullsized":"2023-08-10T10:29:04.440823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344469+0000","last_change":"2023-08-10T10:29:03.447620+0000","last_active":"2023-08-10T10:29:06.344469+0000","last_peered":"2023-08-10T10:29:06.344469+0000","last_clean":"2023-08-10T10:29:06.344469+0000","last_became_active":"2023-08-10T10:29:03.447339+0000","last_became_peered":"2023-08-10T10:29:03.447339+0000","last_unstale":"2023-08-10T10:29:06.344469+0000","last_undegraded":"2023-08-10T10:29:06.344469+0000","last_fullsized":"2023-08-10T10:29:06.344469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796204+0000","last_change":"2023-08-10T10:29:03.450118+0000","last_active":"2023-08-10T10:29:04.796204+0000","last_peered":"2023-08-10T10:29:04.796204+0000","last_clean":"2023-08-10T10:29:04.796204+0000","last_became_active":"2023-08-10T10:29:03.449864+0000","last_became_peered":"2023-08-10T10:29:03.449864+0000","last_unstale":"2023-08-10T10:29:04.796204+0000","last_undegraded":"2023-08-10T10:29:04.796204+0000","last_fullsized":"2023-08-10T10:29:04.796204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344921+0000","last_change":"2023-08-10T10:29:03.451715+0000","last_active":"2023-08-10T10:29:06.344921+0000","last_peered":"2023-08-10T10:29:06.344921+0000","last_clean":"2023-08-10T10:29:06.344921+0000","last_became_active":"2023-08-10T10:29:03.451414+0000","last_became_peered":"2023-08-10T10:29:03.451414+0000","last_unstale":"2023-08-10T10:29:06.344921+0000","last_undegraded":"2023-08-10T10:29:06.344921+0000","last_fullsized":"2023-08-10T10:29:06.344921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435674+0000","last_change":"2023-08-10T10:29:03.443457+0000","last_active":"2023-08-10T10:29:04.435674+0000","last_peered":"2023-08-10T10:29:04.435674+0000","last_clean":"2023-08-10T10:29:04.435674+0000","last_became_active":"2023-08-10T10:29:03.443182+0000","last_became_peered":"2023-08-10T10:29:03.443182+0000","last_unstale":"2023-08-10T10:29:04.435674+0000","last_undegraded":"2023-08-10T10:29:04.435674+0000","last_fullsized":"2023-08-10T10:29:04.435674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344714+0000","last_change":"2023-08-10T10:29:03.448673+0000","last_active":"2023-08-10T10:29:06.344714+0000","last_peered":"2023-08-10T10:29:06.344714+0000","last_clean":"2023-08-10T10:29:06.344714+0000","last_became_active":"2023-08-10T10:29:03.448378+0000","last_became_peered":"2023-08-10T10:29:03.448378+0000","last_unstale":"2023-08-10T10:29:06.344714+0000","last_undegraded":"2023-08-10T10:29:06.344714+0000","last_fullsized":"2023-08-10T10:29:06.344714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441146+0000","last_change":"2023-08-10T10:29:03.445496+0000","last_active":"2023-08-10T10:29:04.441146+0000","last_peered":"2023-08-10T10:29:04.441146+0000","last_clean":"2023-08-10T10:29:04.441146+0000","last_became_active":"2023-08-10T10:29:03.445239+0000","last_became_peered":"2023-08-10T10:29:03.445239+0000","last_unstale":"2023-08-10T10:29:04.441146+0000","last_undegraded":"2023-08-10T10:29:04.441146+0000","last_fullsized":"2023-08-10T10:29:04.441146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:50.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.451219+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.450957+0000","last_became_peered":"2023-08-10T10:29:03.450957+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:22.072828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796266+0000","last_change":"2023-08-10T10:29:03.450677+0000","last_active":"2023-08-10T10:29:04.796266+0000","last_peered":"2023-08-10T10:29:04.796266+0000","last_clean":"2023-08-10T10:29:04.796266+0000","last_became_active":"2023-08-10T10:29:03.450414+0000","last_became_peered":"2023-08-10T10:29:03.450414+0000","last_unstale":"2023-08-10T10:29:04.796266+0000","last_undegraded":"2023-08-10T10:29:04.796266+0000","last_fullsized":"2023-08-10T10:29:04.796266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435726+0000","last_change":"2023-08-10T10:29:03.448733+0000","last_active":"2023-08-10T10:29:04.435726+0000","last_peered":"2023-08-10T10:29:04.435726+0000","last_clean":"2023-08-10T10:29:04.435726+0000","last_became_active":"2023-08-10T10:29:03.448379+0000","last_became_peered":"2023-08-10T10:29:03.448379+0000","last_unstale":"2023-08-10T10:29:04.435726+0000","last_undegraded":"2023-08-10T10:29:04.435726+0000","last_fullsized":"2023-08-10T10:29:04.435726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435953+0000","last_change":"2023-08-10T10:29:03.442226+0000","last_active":"2023-08-10T10:29:04.435953+0000","last_peered":"2023-08-10T10:29:04.435953+0000","last_clean":"2023-08-10T10:29:04.435953+0000","last_became_active":"2023-08-10T10:29:03.441986+0000","last_became_peered":"2023-08-10T10:29:03.441986+0000","last_unstale":"2023-08-10T10:29:04.435953+0000","last_undegraded":"2023-08-10T10:29:04.435953+0000","last_fullsized":"2023-08-10T10:29:04.435953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441131+0000","last_change":"2023-08-10T10:29:03.447854+0000","last_active":"2023-08-10T10:29:04.441131+0000","last_peered":"2023-08-10T10:29:04.441131+0000","last_clean":"2023-08-10T10:29:04.441131+0000","last_became_active":"2023-08-10T10:29:03.447513+0000","last_became_peered":"2023-08-10T10:29:03.447513+0000","last_unstale":"2023-08-10T10:29:04.441131+0000","last_undegraded":"2023-08-10T10:29:04.441131+0000","last_fullsized":"2023-08-10T10:29:04.441131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796072+0000","last_change":"2023-08-10T10:29:03.450633+0000","last_active":"2023-08-10T10:29:04.796072+0000","last_peered":"2023-08-10T10:29:04.796072+0000","last_clean":"2023-08-10T10:29:04.796072+0000","last_became_active":"2023-08-10T10:29:03.450345+0000","last_became_peered":"2023-08-10T10:29:03.450345+0000","last_unstale":"2023-08-10T10:29:04.796072+0000","last_undegraded":"2023-08-10T10:29:04.796072+0000","last_fullsized":"2023-08-10T10:29:04.796072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086320+0000","last_change":"2023-08-10T10:29:03.451595+0000","last_active":"2023-08-10T10:29:06.086320+0000","last_peered":"2023-08-10T10:29:06.086320+0000","last_clean":"2023-08-10T10:29:06.086320+0000","last_became_active":"2023-08-10T10:29:03.451277+0000","last_became_peered":"2023-08-10T10:29:03.451277+0000","last_unstale":"2023-08-10T10:29:06.086320+0000","last_undegraded":"2023-08-10T10:29:06.086320+0000","last_fullsized":"2023-08-10T10:29:06.086320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440927+0000","last_change":"2023-08-10T10:29:03.448073+0000","last_active":"2023-08-10T10:29:04.440927+0000","last_peered":"2023-08-10T10:29:04.440927+0000","last_clean":"2023-08-10T10:29:04.440927+0000","last_became_active":"2023-08-10T10:29:03.447608+0000","last_became_peered":"2023-08-10T10:29:03.447608+0000","last_unstale":"2023-08-10T10:29:04.440927+0000","last_undegraded":"2023-08-10T10:29:04.440927+0000","last_fullsized":"2023-08-10T10:29:04.440927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454476+0000","last_change":"2023-08-10T10:29:03.444304+0000","last_active":"2023-08-10T10:29:06.454476+0000","last_peered":"2023-08-10T10:29:06.454476+0000","last_clean":"2023-08-10T10:29:06.454476+0000","last_became_active":"2023-08-10T10:29:03.441797+0000","last_became_peered":"2023-08-10T10:29:03.441797+0000","last_unstale":"2023-08-10T10:29:06.454476+0000","last_undegraded":"2023-08-10T10:29:06.454476+0000","last_fullsized":"2023-08-10T10:29:06.454476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454588+0000","last_change":"2023-08-10T10:29:03.448858+0000","last_active":"2023-08-10T10:29:06.454588+0000","last_peered":"2023-08-10T10:29:06.454588+0000","last_clean":"2023-08-10T10:29:06.454588+0000","last_became_active":"2023-08-10T10:29:03.448575+0000","last_became_peered":"2023-08-10T10:29:03.448575+0000","last_unstale":"2023-08-10T10:29:06.454588+0000","last_undegraded":"2023-08-10T10:29:06.454588+0000","last_fullsized":"2023-08-10T10:29:06.454588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344741+0000","last_change":"2023-08-10T10:29:03.449820+0000","last_active":"2023-08-10T10:29:06.344741+0000","last_peered":"2023-08-10T10:29:06.344741+0000","last_clean":"2023-08-10T10:29:06.344741+0000","last_became_active":"2023-08-10T10:29:03.449280+0000","last_became_peered":"2023-08-10T10:29:03.449280+0000","last_unstale":"2023-08-10T10:29:06.344741+0000","last_undegraded":"2023-08-10T10:29:06.344741+0000","last_fullsized":"2023-08-10T10:29:06.344741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436273+0000","last_change":"2023-08-10T10:29:02.509556+0000","last_active":"2023-08-10T10:29:04.436273+0000","last_peered":"2023-08-10T10:29:04.436273+0000","last_clean":"2023-08-10T10:29:04.436273+0000","last_became_active":"2023-08-10T10:29:02.509283+0000","last_became_peered":"2023-08-10T10:29:02.509283+0000","last_unstale":"2023-08-10T10:29:04.436273+0000","last_undegraded":"2023-08-10T10:29:04.436273+0000","last_fullsized":"2023-08-10T10:29:04.436273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086441+0000","last_change":"2023-08-10T10:29:03.443570+0000","last_active":"2023-08-10T10:29:06.086441+0000","last_peered":"2023-08-10T10:29:06.086441+0000","last_clean":"2023-08-10T10:29:06.086441+0000","last_became_active":"2023-08-10T10:29:03.443302+0000","last_became_peered":"2023-08-10T10:29:03.443302+0000","last_unstale":"2023-08-10T10:29:06.086441+0000","last_undegraded":"2023-08-10T10:29:06.086441+0000","last_fullsized":"2023-08-10T10:29:06.086441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454280+0000","last_change":"2023-08-10T10:29:02.510076+0000","last_active":"2023-08-10T10:29:06.454280+0000","last_peered":"2023-08-10T10:29:06.454280+0000","last_clean":"2023-08-10T10:29:06.454280+0000","last_became_active":"2023-08-10T10:29:02.509806+0000","last_became_peered":"2023-08-10T10:29:02.509806+0000","last_unstale":"2023-08-10T10:29:06.454280+0000","last_undegraded":"2023-08-10T10:29:06.454280+0000","last_fullsized":"2023-08-10T10:29:06.454280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796264+0000","last_change":"2023-08-10T10:29:03.450711+0000","last_active":"2023-08-10T10:29:04.796264+0000","last_peered":"2023-08-10T10:29:04.796264+0000","last_clean":"2023-08-10T10:29:04.796264+0000","last_became_active":"2023-08-10T10:29:03.450363+0000","last_became_peered":"2023-08-10T10:29:03.450363+0000","last_unstale":"2023-08-10T10:29:04.796264+0000","last_undegraded":"2023-08-10T10:29:04.796264+0000","last_fullsized":"2023-08-10T10:29:04.796264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086179+0000","last_change":"2023-08-10T10:29:02.509352+0000","last_active":"2023-08-10T10:29:06.086179+0000","last_peered":"2023-08-10T10:29:06.086179+0000","last_clean":"2023-08-10T10:29:06.086179+0000","last_became_active":"2023-08-10T10:29:02.509050+0000","last_became_peered":"2023-08-10T10:29:02.509050+0000","last_unstale":"2023-08-10T10:29:06.086179+0000","last_undegraded":"2023-08-10T10:29:06.086179+0000","last_fullsized":"2023-08-10T10:29:06.086179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:03.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564688+0000","last_change":"2023-08-10T10:29:03.449521+0000","last_active":"2023-08-10T10:29:06.564688+0000","last_peered":"2023-08-10T10:29:06.564688+0000","last_clean":"2023-08-10T10:29:06.564688+0000","last_became_active":"2023-08-10T10:29:03.449254+0000","last_became_peered":"2023-08-10T10:29:03.449254+0000","last_unstale":"2023-08-10T10:29:06.564688+0000","last_undegraded":"2023-08-10T10:29:06.564688+0000","last_fullsized":"2023-08-10T10:29:06.564688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:52.435268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796291+0000","last_change":"2023-08-10T10:29:02.514169+0000","last_active":"2023-08-10T10:29:04.796291+0000","last_peered":"2023-08-10T10:29:04.796291+0000","last_clean":"2023-08-10T10:29:04.796291+0000","last_became_active":"2023-08-10T10:29:02.513967+0000","last_became_peered":"2023-08-10T10:29:02.513967+0000","last_unstale":"2023-08-10T10:29:04.796291+0000","last_undegraded":"2023-08-10T10:29:04.796291+0000","last_fullsized":"2023-08-10T10:29:04.796291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086126+0000","last_change":"2023-08-10T10:29:03.440626+0000","last_active":"2023-08-10T10:29:06.086126+0000","last_peered":"2023-08-10T10:29:06.086126+0000","last_clean":"2023-08-10T10:29:06.086126+0000","last_became_active":"2023-08-10T10:29:03.440266+0000","last_became_peered":"2023-08-10T10:29:03.440266+0000","last_unstale":"2023-08-10T10:29:06.086126+0000","last_undegraded":"2023-08-10T10:29:06.086126+0000","last_fullsized":"2023-08-10T10:29:06.086126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344756+0000","last_change":"2023-08-10T10:29:02.505024+0000","last_active":"2023-08-10T10:29:06.344756+0000","last_peered":"2023-08-10T10:29:06.344756+0000","last_clean":"2023-08-10T10:29:06.344756+0000","last_became_active":"2023-08-10T10:29:02.504178+0000","last_became_peered":"2023-08-10T10:29:02.504178+0000","last_unstale":"2023-08-10T10:29:06.344756+0000","last_undegraded":"2023-08-10T10:29:06.344756+0000","last_fullsized":"2023-08-10T10:29:06.344756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:18.093416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086183+0000","last_change":"2023-08-10T10:29:03.444252+0000","last_active":"2023-08-10T10:29:06.086183+0000","last_peered":"2023-08-10T10:29:06.086183+0000","last_clean":"2023-08-10T10:29:06.086183+0000","last_became_active":"2023-08-10T10:29:03.443982+0000","last_became_peered":"2023-08-10T10:29:03.443982+0000","last_unstale":"2023-08-10T10:29:06.086183+0000","last_undegraded":"2023-08-10T10:29:06.086183+0000","last_fullsized":"2023-08-10T10:29:06.086183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441209+0000","last_change":"2023-08-10T10:29:02.510256+0000","last_active":"2023-08-10T10:29:04.441209+0000","last_peered":"2023-08-10T10:29:04.441209+0000","last_clean":"2023-08-10T10:29:04.441209+0000","last_became_active":"2023-08-10T10:29:02.510054+0000","last_became_peered":"2023-08-10T10:29:02.510054+0000","last_unstale":"2023-08-10T10:29:04.441209+0000","last_undegraded":"2023-08-10T10:29:04.441209+0000","last_fullsized":"2023-08-10T10:29:04.441209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:03.509285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454279+0000","last_change":"2023-08-10T10:29:03.442886+0000","last_active":"2023-08-10T10:29:06.454279+0000","last_peered":"2023-08-10T10:29:06.454279+0000","last_clean":"2023-08-10T10:29:06.454279+0000","last_became_active":"2023-08-10T10:29:03.442103+0000","last_became_peered":"2023-08-10T10:29:03.442103+0000","last_unstale":"2023-08-10T10:29:06.454279+0000","last_undegraded":"2023-08-10T10:29:06.454279+0000","last_fullsized":"2023-08-10T10:29:06.454279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436220+0000","last_change":"2023-08-10T10:29:02.504354+0000","last_active":"2023-08-10T10:29:04.436220+0000","last_peered":"2023-08-10T10:29:04.436220+0000","last_clean":"2023-08-10T10:29:04.436220+0000","last_became_active":"2023-08-10T10:29:02.503879+0000","last_became_peered":"2023-08-10T10:29:02.503879+0000","last_unstale":"2023-08-10T10:29:04.436220+0000","last_undegraded":"2023-08-10T10:29:04.436220+0000","last_fullsized":"2023-08-10T10:29:04.436220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436378+0000","last_change":"2023-08-10T10:29:03.440803+0000","last_active":"2023-08-10T10:29:04.436378+0000","last_peered":"2023-08-10T10:29:04.436378+0000","last_clean":"2023-08-10T10:29:04.436378+0000","last_became_active":"2023-08-10T10:29:03.440491+0000","last_became_peered":"2023-08-10T10:29:03.440491+0000","last_unstale":"2023-08-10T10:29:04.436378+0000","last_undegraded":"2023-08-10T10:29:04.436378+0000","last_fullsized":"2023-08-10T10:29:04.436378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:04.510976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441036+0000","last_change":"2023-08-10T10:29:02.506354+0000","last_active":"2023-08-10T10:29:04.441036+0000","last_peered":"2023-08-10T10:29:04.441036+0000","last_clean":"2023-08-10T10:29:04.441036+0000","last_became_active":"2023-08-10T10:29:02.506110+0000","last_became_peered":"2023-08-10T10:29:02.506110+0000","last_unstale":"2023-08-10T10:29:04.441036+0000","last_undegraded":"2023-08-10T10:29:04.441036+0000","last_fullsized":"2023-08-10T10:29:04.441036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.953593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086288+0000","last_change":"2023-08-10T10:29:03.443853+0000","last_active":"2023-08-10T10:29:06.086288+0000","last_peered":"2023-08-10T10:29:06.086288+0000","last_clean":"2023-08-10T10:29:06.086288+0000","last_became_active":"2023-08-10T10:29:03.443591+0000","last_became_peered":"2023-08-10T10:29:03.443591+0000","last_unstale":"2023-08-10T10:29:06.086288+0000","last_undegraded":"2023-08-10T10:29:06.086288+0000","last_fullsized":"2023-08-10T10:29:06.086288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796014+0000","last_change":"2023-08-10T10:29:02.508938+0000","last_active":"2023-08-10T10:29:04.796014+0000","last_peered":"2023-08-10T10:29:04.796014+0000","last_clean":"2023-08-10T10:29:04.796014+0000","last_became_active":"2023-08-10T10:29:02.508669+0000","last_became_peered":"2023-08-10T10:29:02.508669+0000","last_unstale":"2023-08-10T10:29:04.796014+0000","last_undegraded":"2023-08-10T10:29:04.796014+0000","last_fullsized":"2023-08-10T10:29:04.796014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344680+0000","last_change":"2023-08-10T10:29:03.450335+0000","last_active":"2023-08-10T10:29:06.344680+0000","last_peered":"2023-08-10T10:29:06.344680+0000","last_clean":"2023-08-10T10:29:06.344680+0000","last_became_active":"2023-08-10T10:29:03.449118+0000","last_became_peered":"2023-08-10T10:29:03.449118+0000","last_unstale":"2023-08-10T10:29:06.344680+0000","last_undegraded":"2023-08-10T10:29:06.344680+0000","last_fullsized":"2023-08-10T10:29:06.344680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440904+0000","last_change":"2023-08-10T10:29:02.508190+0000","last_active":"2023-08-10T10:29:04.440904+0000","last_peered":"2023-08-10T10:29:04.440904+0000","last_clean":"2023-08-10T10:29:04.440904+0000","last_became_active":"2023-08-10T10:29:02.507882+0000","last_became_peered":"2023-08-10T10:29:02.507882+0000","last_unstale":"2023-08-10T10:29:04.440904+0000","last_undegraded":"2023-08-10T10:29:04.440904+0000","last_fullsized":"2023-08-10T10:29:04.440904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796210+0000","last_change":"2023-08-10T10:29:03.448316+0000","last_active":"2023-08-10T10:29:04.796210+0000","last_peered":"2023-08-10T10:29:04.796210+0000","last_clean":"2023-08-10T10:29:04.796210+0000","last_became_active":"2023-08-10T10:29:03.447711+0000","last_became_peered":"2023-08-10T10:29:03.447711+0000","last_unstale":"2023-08-10T10:29:04.796210+0000","last_undegraded":"2023-08-10T10:29:04.796210+0000","last_fullsized":"2023-08-10T10:29:04.796210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564253+0000","last_change":"2023-08-10T10:29:02.508683+0000","last_active":"2023-08-10T10:29:06.564253+0000","last_peered":"2023-08-10T10:29:06.564253+0000","last_clean":"2023-08-10T10:29:06.564253+0000","last_became_active":"2023-08-10T10:29:02.508399+0000","last_became_peered":"2023-08-10T10:29:02.508399+0000","last_unstale":"2023-08-10T10:29:06.564253+0000","last_undegraded":"2023-08-10T10:29:06.564253+0000","last_fullsized":"2023-08-10T10:29:06.564253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:45.110488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086773+0000","last_change":"2023-08-10T10:29:03.444878+0000","last_active":"2023-08-10T10:29:06.086773+0000","last_peered":"2023-08-10T10:29:06.086773+0000","last_clean":"2023-08-10T10:29:06.086773+0000","last_became_active":"2023-08-10T10:29:03.444560+0000","last_became_peered":"2023-08-10T10:29:03.444560+0000","last_unstale":"2023-08-10T10:29:06.086773+0000","last_undegraded":"2023-08-10T10:29:06.086773+0000","last_fullsized":"2023-08-10T10:29:06.086773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441325+0000","last_change":"2023-08-10T10:29:02.506132+0000","last_active":"2023-08-10T10:29:04.441325+0000","last_peered":"2023-08-10T10:29:04.441325+0000","last_clean":"2023-08-10T10:29:04.441325+0000","last_became_active":"2023-08-10T10:29:02.505862+0000","last_became_peered":"2023-08-10T10:29:02.505862+0000","last_unstale":"2023-08-10T10:29:04.441325+0000","last_undegraded":"2023-08-10T10:29:04.441325+0000","last_fullsized":"2023-08-10T10:29:04.441325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:53.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344467+0000","last_change":"2023-08-10T10:29:03.448717+0000","last_active":"2023-08-10T10:29:06.344467+0000","last_peered":"2023-08-10T10:29:06.344467+0000","last_clean":"2023-08-10T10:29:06.344467+0000","last_became_active":"2023-08-10T10:29:03.448231+0000","last_became_peered":"2023-08-10T10:29:03.448231+0000","last_unstale":"2023-08-10T10:29:06.344467+0000","last_undegraded":"2023-08-10T10:29:06.344467+0000","last_fullsized":"2023-08-10T10:29:06.344467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441232+0000","last_change":"2023-08-10T10:29:02.503467+0000","last_active":"2023-08-10T10:29:04.441232+0000","last_peered":"2023-08-10T10:29:04.441232+0000","last_clean":"2023-08-10T10:29:04.441232+0000","last_became_active":"2023-08-10T10:29:02.503095+0000","last_became_peered":"2023-08-10T10:29:02.503095+0000","last_unstale":"2023-08-10T10:29:04.441232+0000","last_undegraded":"2023-08-10T10:29:04.441232+0000","last_fullsized":"2023-08-10T10:29:04.441232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:52.156146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.443580+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.443304+0000","last_became_peered":"2023-08-10T10:29:03.443304+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441314+0000","last_change":"2023-08-10T10:29:02.508008+0000","last_active":"2023-08-10T10:29:04.441314+0000","last_peered":"2023-08-10T10:29:04.441314+0000","last_clean":"2023-08-10T10:29:04.441314+0000","last_became_active":"2023-08-10T10:29:02.507657+0000","last_became_peered":"2023-08-10T10:29:02.507657+0000","last_unstale":"2023-08-10T10:29:04.441314+0000","last_undegraded":"2023-08-10T10:29:04.441314+0000","last_fullsized":"2023-08-10T10:29:04.441314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:55.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564606+0000","last_change":"2023-08-10T10:29:03.440621+0000","last_active":"2023-08-10T10:29:06.564606+0000","last_peered":"2023-08-10T10:29:06.564606+0000","last_clean":"2023-08-10T10:29:06.564606+0000","last_became_active":"2023-08-10T10:29:03.440332+0000","last_became_peered":"2023-08-10T10:29:03.440332+0000","last_unstale":"2023-08-10T10:29:06.564606+0000","last_undegraded":"2023-08-10T10:29:06.564606+0000","last_fullsized":"2023-08-10T10:29:06.564606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344711+0000","last_change":"2023-08-10T10:29:02.509818+0000","last_active":"2023-08-10T10:29:06.344711+0000","last_peered":"2023-08-10T10:29:06.344711+0000","last_clean":"2023-08-10T10:29:06.344711+0000","last_became_active":"2023-08-10T10:29:02.509518+0000","last_became_peered":"2023-08-10T10:29:02.509518+0000","last_unstale":"2023-08-10T10:29:06.344711+0000","last_undegraded":"2023-08-10T10:29:06.344711+0000","last_fullsized":"2023-08-10T10:29:06.344711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796348+0000","last_change":"2023-08-10T10:29:03.447884+0000","last_active":"2023-08-10T10:29:04.796348+0000","last_peered":"2023-08-10T10:29:04.796348+0000","last_clean":"2023-08-10T10:29:04.796348+0000","last_became_active":"2023-08-10T10:29:03.447609+0000","last_became_peered":"2023-08-10T10:29:03.447609+0000","last_unstale":"2023-08-10T10:29:04.796348+0000","last_undegraded":"2023-08-10T10:29:04.796348+0000","last_fullsized":"2023-08-10T10:29:04.796348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086361+0000","last_change":"2023-08-10T10:29:02.508827+0000","last_active":"2023-08-10T10:29:06.086361+0000","last_peered":"2023-08-10T10:29:06.086361+0000","last_clean":"2023-08-10T10:29:06.086361+0000","last_became_active":"2023-08-10T10:29:02.508532+0000","last_became_peered":"2023-08-10T10:29:02.508532+0000","last_unstale":"2023-08-10T10:29:06.086361+0000","last_undegraded":"2023-08-10T10:29:06.086361+0000","last_fullsized":"2023-08-10T10:29:06.086361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436080+0000","last_change":"2023-08-10T10:29:03.442543+0000","last_active":"2023-08-10T10:29:04.436080+0000","last_peered":"2023-08-10T10:29:04.436080+0000","last_clean":"2023-08-10T10:29:04.436080+0000","last_became_active":"2023-08-10T10:29:03.439760+0000","last_became_peered":"2023-08-10T10:29:03.439760+0000","last_unstale":"2023-08-10T10:29:04.436080+0000","last_undegraded":"2023-08-10T10:29:04.436080+0000","last_fullsized":"2023-08-10T10:29:04.436080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564433+0000","last_change":"2023-08-10T10:29:02.511617+0000","last_active":"2023-08-10T10:29:06.564433+0000","last_peered":"2023-08-10T10:29:06.564433+0000","last_clean":"2023-08-10T10:29:06.564433+0000","last_became_active":"2023-08-10T10:29:02.511332+0000","last_became_peered":"2023-08-10T10:29:02.511332+0000","last_unstale":"2023-08-10T10:29:06.564433+0000","last_undegraded":"2023-08-10T10:29:06.564433+0000","last_fullsized":"2023-08-10T10:29:06.564433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:42.078663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435889+0000","last_change":"2023-08-10T10:29:03.438600+0000","last_active":"2023-08-10T10:29:04.435889+0000","last_peered":"2023-08-10T10:29:04.435889+0000","last_clean":"2023-08-10T10:29:04.435889+0000","last_became_active":"2023-08-10T10:29:03.438329+0000","last_became_peered":"2023-08-10T10:29:03.438329+0000","last_unstale":"2023-08-10T10:29:04.435889+0000","last_undegraded":"2023-08-10T10:29:04.435889+0000","last_fullsized":"2023-08-10T10:29:04.435889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435725+0000","last_change":"2023-08-10T10:29:02.501143+0000","last_active":"2023-08-10T10:29:04.435725+0000","last_peered":"2023-08-10T10:29:04.435725+0000","last_clean":"2023-08-10T10:29:04.435725+0000","last_became_active":"2023-08-10T10:29:02.500734+0000","last_became_peered":"2023-08-10T10:29:02.500734+0000","last_unstale":"2023-08-10T10:29:04.435725+0000","last_undegraded":"2023-08-10T10:29:04.435725+0000","last_fullsized":"2023-08-10T10:29:04.435725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435945+0000","last_change":"2023-08-10T10:29:03.441585+0000","last_active":"2023-08-10T10:29:04.435945+0000","last_peered":"2023-08-10T10:29:04.435945+0000","last_clean":"2023-08-10T10:29:04.435945+0000","last_became_active":"2023-08-10T10:29:03.441315+0000","last_became_peered":"2023-08-10T10:29:03.441315+0000","last_unstale":"2023-08-10T10:29:04.435945+0000","last_undegraded":"2023-08-10T10:29:04.435945+0000","last_fullsized":"2023-08-10T10:29:04.435945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086015+0000","last_change":"2023-08-10T10:29:02.509843+0000","last_active":"2023-08-10T10:29:06.086015+0000","last_peered":"2023-08-10T10:29:06.086015+0000","last_clean":"2023-08-10T10:29:06.086015+0000","last_became_active":"2023-08-10T10:29:02.509581+0000","last_became_peered":"2023-08-10T10:29:02.509581+0000","last_unstale":"2023-08-10T10:29:06.086015+0000","last_undegraded":"2023-08-10T10:29:06.086015+0000","last_fullsized":"2023-08-10T10:29:06.086015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454594+0000","last_change":"2023-08-10T10:29:03.447663+0000","last_active":"2023-08-10T10:29:06.454594+0000","last_peered":"2023-08-10T10:29:06.454594+0000","last_clean":"2023-08-10T10:29:06.454594+0000","last_became_active":"2023-08-10T10:29:03.447249+0000","last_became_peered":"2023-08-10T10:29:03.447249+0000","last_unstale":"2023-08-10T10:29:06.454594+0000","last_undegraded":"2023-08-10T10:29:06.454594+0000","last_fullsized":"2023-08-10T10:29:06.454594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.453942+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:06.453942+0000","last_peered":"2023-08-10T10:29:06.453942+0000","last_clean":"2023-08-10T10:29:06.453942+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:06.453942+0000","last_undegraded":"2023-08-10T10:29:06.453942+0000","last_fullsized":"2023-08-10T10:29:06.453942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:30.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344840+0000","last_change":"2023-08-10T10:29:02.509950+0000","last_active":"2023-08-10T10:29:06.344840+0000","last_peered":"2023-08-10T10:29:06.344840+0000","last_clean":"2023-08-10T10:29:06.344840+0000","last_became_active":"2023-08-10T10:29:02.509612+0000","last_became_peered":"2023-08-10T10:29:02.509612+0000","last_unstale":"2023-08-10T10:29:06.344840+0000","last_undegraded":"2023-08-10T10:29:06.344840+0000","last_fullsized":"2023-08-10T10:29:06.344840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454290+0000","last_change":"2023-08-10T10:29:03.448544+0000","last_active":"2023-08-10T10:29:06.454290+0000","last_peered":"2023-08-10T10:29:06.454290+0000","last_clean":"2023-08-10T10:29:06.454290+0000","last_became_active":"2023-08-10T10:29:03.448140+0000","last_became_peered":"2023-08-10T10:29:03.448140+0000","last_unstale":"2023-08-10T10:29:06.454290+0000","last_undegraded":"2023-08-10T10:29:06.454290+0000","last_fullsized":"2023-08-10T10:29:06.454290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344627+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:06.344627+0000","last_peered":"2023-08-10T10:29:06.344627+0000","last_clean":"2023-08-10T10:29:06.344627+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:06.344627+0000","last_undegraded":"2023-08-10T10:29:06.344627+0000","last_fullsized":"2023-08-10T10:29:06.344627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:39.055486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436302+0000","last_change":"2023-08-10T10:29:02.508916+0000","last_active":"2023-08-10T10:29:04.436302+0000","last_peered":"2023-08-10T10:29:04.436302+0000","last_clean":"2023-08-10T10:29:04.436302+0000","last_became_active":"2023-08-10T10:29:02.508630+0000","last_became_peered":"2023-08-10T10:29:02.508630+0000","last_unstale":"2023-08-10T10:29:04.436302+0000","last_undegraded":"2023-08-10T10:29:04.436302+0000","last_fullsized":"2023-08-10T10:29:04.436302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:28.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454399+0000","last_change":"2023-08-10T10:29:03.449910+0000","last_active":"2023-08-10T10:29:06.454399+0000","last_peered":"2023-08-10T10:29:06.454399+0000","last_clean":"2023-08-10T10:29:06.454399+0000","last_became_active":"2023-08-10T10:29:03.449231+0000","last_became_peered":"2023-08-10T10:29:03.449231+0000","last_unstale":"2023-08-10T10:29:06.454399+0000","last_undegraded":"2023-08-10T10:29:06.454399+0000","last_fullsized":"2023-08-10T10:29:06.454399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454065+0000","last_change":"2023-08-10T10:29:02.506926+0000","last_active":"2023-08-10T10:29:06.454065+0000","last_peered":"2023-08-10T10:29:06.454065+0000","last_clean":"2023-08-10T10:29:06.454065+0000","last_became_active":"2023-08-10T10:29:02.506687+0000","last_became_peered":"2023-08-10T10:29:02.506687+0000","last_unstale":"2023-08-10T10:29:06.454065+0000","last_undegraded":"2023-08-10T10:29:06.454065+0000","last_fullsized":"2023-08-10T10:29:06.454065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454532+0000","last_change":"2023-08-10T10:29:03.450582+0000","last_active":"2023-08-10T10:29:06.454532+0000","last_peered":"2023-08-10T10:29:06.454532+0000","last_clean":"2023-08-10T10:29:06.454532+0000","last_became_active":"2023-08-10T10:29:03.450087+0000","last_became_peered":"2023-08-10T10:29:03.450087+0000","last_unstale":"2023-08-10T10:29:06.454532+0000","last_undegraded":"2023-08-10T10:29:06.454532+0000","last_fullsized":"2023-08-10T10:29:06.454532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344340+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:06.344340+0000","last_peered":"2023-08-10T10:29:06.344340+0000","last_clean":"2023-08-10T10:29:06.344340+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:06.344340+0000","last_undegraded":"2023-08-10T10:29:06.344340+0000","last_fullsized":"2023-08-10T10:29:06.344340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:43.417388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440678+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:04.440678+0000","last_peered":"2023-08-10T10:29:04.440678+0000","last_clean":"2023-08-10T10:29:04.440678+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:04.440678+0000","last_undegraded":"2023-08-10T10:29:04.440678+0000","last_fullsized":"2023-08-10T10:29:04.440678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:15.475871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086186+0000","last_change":"2023-08-10T10:29:02.509636+0000","last_active":"2023-08-10T10:29:06.086186+0000","last_peered":"2023-08-10T10:29:06.086186+0000","last_clean":"2023-08-10T10:29:06.086186+0000","last_became_active":"2023-08-10T10:29:02.509357+0000","last_became_peered":"2023-08-10T10:29:02.509357+0000","last_unstale":"2023-08-10T10:29:06.086186+0000","last_undegraded":"2023-08-10T10:29:06.086186+0000","last_fullsized":"2023-08-10T10:29:06.086186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:10.904417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564564+0000","last_change":"2023-08-10T10:29:03.443731+0000","last_active":"2023-08-10T10:29:06.564564+0000","last_peered":"2023-08-10T10:29:06.564564+0000","last_clean":"2023-08-10T10:29:06.564564+0000","last_became_active":"2023-08-10T10:29:03.443369+0000","last_became_peered":"2023-08-10T10:29:03.443369+0000","last_unstale":"2023-08-10T10:29:06.564564+0000","last_undegraded":"2023-08-10T10:29:06.564564+0000","last_fullsized":"2023-08-10T10:29:06.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:14.287109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440834+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:04.440834+0000","last_peered":"2023-08-10T10:29:04.440834+0000","last_clean":"2023-08-10T10:29:04.440834+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:04.440834+0000","last_undegraded":"2023-08-10T10:29:04.440834+0000","last_fullsized":"2023-08-10T10:29:04.440834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796044+0000","last_change":"2023-08-10T10:29:02.508404+0000","last_active":"2023-08-10T10:29:04.796044+0000","last_peered":"2023-08-10T10:29:04.796044+0000","last_clean":"2023-08-10T10:29:04.796044+0000","last_became_active":"2023-08-10T10:29:02.508118+0000","last_became_peered":"2023-08-10T10:29:02.508118+0000","last_unstale":"2023-08-10T10:29:04.796044+0000","last_undegraded":"2023-08-10T10:29:04.796044+0000","last_fullsized":"2023-08-10T10:29:04.796044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:21.071137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796403+0000","last_change":"2023-08-10T10:29:03.449361+0000","last_active":"2023-08-10T10:29:04.796403+0000","last_peered":"2023-08-10T10:29:04.796403+0000","last_clean":"2023-08-10T10:29:04.796403+0000","last_became_active":"2023-08-10T10:29:03.448855+0000","last_became_peered":"2023-08-10T10:29:03.448855+0000","last_unstale":"2023-08-10T10:29:04.796403+0000","last_undegraded":"2023-08-10T10:29:04.796403+0000","last_fullsized":"2023-08-10T10:29:04.796403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441134+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:04.441134+0000","last_peered":"2023-08-10T10:29:04.441134+0000","last_clean":"2023-08-10T10:29:04.441134+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:04.441134+0000","last_undegraded":"2023-08-10T10:29:04.441134+0000","last_fullsized":"2023-08-10T10:29:04.441134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:24.224979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454493+0000","last_change":"2023-08-10T10:29:02.507620+0000","last_active":"2023-08-10T10:29:06.454493+0000","last_peered":"2023-08-10T10:29:06.454493+0000","last_clean":"2023-08-10T10:29:06.454493+0000","last_became_active":"2023-08-10T10:29:02.507334+0000","last_became_peered":"2023-08-10T10:29:02.507334+0000","last_unstale":"2023-08-10T10:29:06.454493+0000","last_undegraded":"2023-08-10T10:29:06.454493+0000","last_fullsized":"2023-08-10T10:29:06.454493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796133+0000","last_change":"2023-08-10T10:29:03.451179+0000","last_active":"2023-08-10T10:29:04.796133+0000","last_peered":"2023-08-10T10:29:04.796133+0000","last_clean":"2023-08-10T10:29:04.796133+0000","last_became_active":"2023-08-10T10:29:03.450918+0000","last_became_peered":"2023-08-10T10:29:03.450918+0000","last_unstale":"2023-08-10T10:29:04.796133+0000","last_undegraded":"2023-08-10T10:29:04.796133+0000","last_fullsized":"2023-08-10T10:29:04.796133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086651+0000","last_change":"2023-08-10T10:29:02.509567+0000","last_active":"2023-08-10T10:29:06.086651+0000","last_peered":"2023-08-10T10:29:06.086651+0000","last_clean":"2023-08-10T10:29:06.086651+0000","last_became_active":"2023-08-10T10:29:02.509227+0000","last_became_peered":"2023-08-10T10:29:02.509227+0000","last_unstale":"2023-08-10T10:29:06.086651+0000","last_undegraded":"2023-08-10T10:29:06.086651+0000","last_fullsized":"2023-08-10T10:29:06.086651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454598+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:06.454598+0000","last_peered":"2023-08-10T10:29:06.454598+0000","last_clean":"2023-08-10T10:29:06.454598+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:06.454598+0000","last_undegraded":"2023-08-10T10:29:06.454598+0000","last_fullsized":"2023-08-10T10:29:06.454598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.085979+0000","last_change":"2023-08-10T10:29:03.445049+0000","last_active":"2023-08-10T10:29:06.085979+0000","last_peered":"2023-08-10T10:29:06.085979+0000","last_clean":"2023-08-10T10:29:06.085979+0000","last_became_active":"2023-08-10T10:29:03.444724+0000","last_became_peered":"2023-08-10T10:29:03.444724+0000","last_unstale":"2023-08-10T10:29:06.085979+0000","last_undegraded":"2023-08-10T10:29:06.085979+0000","last_fullsized":"2023-08-10T10:29:06.085979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564247+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:06.564247+0000","last_peered":"2023-08-10T10:29:06.564247+0000","last_clean":"2023-08-10T10:29:06.564247+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:06.564247+0000","last_undegraded":"2023-08-10T10:29:06.564247+0000","last_fullsized":"2023-08-10T10:29:06.564247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:51.252030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.208517+0000","last_change":"2023-08-10T10:29:02.508685+0000","last_active":"2023-08-10T10:29:06.208517+0000","last_peered":"2023-08-10T10:29:06.208517+0000","last_clean":"2023-08-10T10:29:06.208517+0000","last_became_active":"2023-08-10T10:29:02.508376+0000","last_became_peered":"2023-08-10T10:29:02.508376+0000","last_unstale":"2023-08-10T10:29:06.208517+0000","last_undegraded":"2023-08-10T10:29:06.208517+0000","last_fullsized":"2023-08-10T10:29:06.208517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435479+0000","last_change":"2023-08-10T10:29:03.449122+0000","last_active":"2023-08-10T10:29:04.435479+0000","last_peered":"2023-08-10T10:29:04.435479+0000","last_clean":"2023-08-10T10:29:04.435479+0000","last_became_active":"2023-08-10T10:29:03.448040+0000","last_became_peered":"2023-08-10T10:29:03.448040+0000","last_unstale":"2023-08-10T10:29:04.435479+0000","last_undegraded":"2023-08-10T10:29:04.435479+0000","last_fullsized":"2023-08-10T10:29:04.435479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796191+0000","last_change":"2023-08-10T10:29:02.511445+0000","last_active":"2023-08-10T10:29:04.796191+0000","last_peered":"2023-08-10T10:29:04.796191+0000","last_clean":"2023-08-10T10:29:04.796191+0000","last_became_active":"2023-08-10T10:29:02.511184+0000","last_became_peered":"2023-08-10T10:29:02.511184+0000","last_unstale":"2023-08-10T10:29:04.796191+0000","last_undegraded":"2023-08-10T10:29:04.796191+0000","last_fullsized":"2023-08-10T10:29:04.796191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344717+0000","last_change":"2023-08-10T10:29:02.506009+0000","last_active":"2023-08-10T10:29:06.344717+0000","last_peered":"2023-08-10T10:29:06.344717+0000","last_clean":"2023-08-10T10:29:06.344717+0000","last_became_active":"2023-08-10T10:29:02.505751+0000","last_became_peered":"2023-08-10T10:29:02.505751+0000","last_unstale":"2023-08-10T10:29:06.344717+0000","last_undegraded":"2023-08-10T10:29:06.344717+0000","last_fullsized":"2023-08-10T10:29:06.344717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436211+0000","last_change":"2023-08-10T10:29:03.440207+0000","last_active":"2023-08-10T10:29:04.436211+0000","last_peered":"2023-08-10T10:29:04.436211+0000","last_clean":"2023-08-10T10:29:04.436211+0000","last_became_active":"2023-08-10T10:29:03.439702+0000","last_became_peered":"2023-08-10T10:29:03.439702+0000","last_unstale":"2023-08-10T10:29:04.436211+0000","last_undegraded":"2023-08-10T10:29:04.436211+0000","last_fullsized":"2023-08-10T10:29:04.436211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344916+0000","last_change":"2023-08-10T10:29:02.507533+0000","last_active":"2023-08-10T10:29:06.344916+0000","last_peered":"2023-08-10T10:29:06.344916+0000","last_clean":"2023-08-10T10:29:06.344916+0000","last_became_active":"2023-08-10T10:29:02.507215+0000","last_became_peered":"2023-08-10T10:29:02.507215+0000","last_unstale":"2023-08-10T10:29:06.344916+0000","last_undegraded":"2023-08-10T10:29:06.344916+0000","last_fullsized":"2023-08-10T10:29:06.344916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436223+0000","last_change":"2023-08-10T10:29:03.440169+0000","last_active":"2023-08-10T10:29:04.436223+0000","last_peered":"2023-08-10T10:29:04.436223+0000","last_clean":"2023-08-10T10:29:04.436223+0000","last_became_active":"2023-08-10T10:29:03.439746+0000","last_became_peered":"2023-08-10T10:29:03.439746+0000","last_unstale":"2023-08-10T10:29:04.436223+0000","last_undegraded":"2023-08-10T10:29:04.436223+0000","last_fullsized":"2023-08-10T10:29:04.436223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086444+0000","last_change":"2023-08-10T10:29:02.508038+0000","last_active":"2023-08-10T10:29:06.086444+0000","last_peered":"2023-08-10T10:29:06.086444+0000","last_clean":"2023-08-10T10:29:06.086444+0000","last_became_active":"2023-08-10T10:29:02.507705+0000","last_became_peered":"2023-08-10T10:29:02.507705+0000","last_unstale":"2023-08-10T10:29:06.086444+0000","last_undegraded":"2023-08-10T10:29:06.086444+0000","last_fullsized":"2023-08-10T10:29:06.086444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086412+0000","last_change":"2023-08-10T10:29:03.439576+0000","last_active":"2023-08-10T10:29:06.086412+0000","last_peered":"2023-08-10T10:29:06.086412+0000","last_clean":"2023-08-10T10:29:06.086412+0000","last_became_active":"2023-08-10T10:29:03.439303+0000","last_became_peered":"2023-08-10T10:29:03.439303+0000","last_unstale":"2023-08-10T10:29:06.086412+0000","last_undegraded":"2023-08-10T10:29:06.086412+0000","last_fullsized":"2023-08-10T10:29:06.086412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796395+0000","last_change":"2023-08-10T10:29:02.514204+0000","last_active":"2023-08-10T10:29:04.796395+0000","last_peered":"2023-08-10T10:29:04.796395+0000","last_clean":"2023-08-10T10:29:04.796395+0000","last_became_active":"2023-08-10T10:29:02.514038+0000","last_became_peered":"2023-08-10T10:29:02.514038+0000","last_unstale":"2023-08-10T10:29:04.796395+0000","last_undegraded":"2023-08-10T10:29:04.796395+0000","last_fullsized":"2023-08-10T10:29:04.796395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435320+0000","last_change":"2023-08-10T10:29:03.440843+0000","last_active":"2023-08-10T10:29:04.435320+0000","last_peered":"2023-08-10T10:29:04.435320+0000","last_clean":"2023-08-10T10:29:04.435320+0000","last_became_active":"2023-08-10T10:29:03.440587+0000","last_became_peered":"2023-08-10T10:29:03.440587+0000","last_unstale":"2023-08-10T10:29:04.435320+0000","last_undegraded":"2023-08-10T10:29:04.435320+0000","last_fullsized":"2023-08-10T10:29:04.435320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564382+0000","last_change":"2023-08-10T10:29:03.448796+0000","last_active":"2023-08-10T10:29:06.564382+0000","last_peered":"2023-08-10T10:29:06.564382+0000","last_clean":"2023-08-10T10:29:06.564382+0000","last_became_active":"2023-08-10T10:29:03.448489+0000","last_became_peered":"2023-08-10T10:29:03.448489+0000","last_unstale":"2023-08-10T10:29:06.564382+0000","last_undegraded":"2023-08-10T10:29:06.564382+0000","last_fullsized":"2023-08-10T10:29:06.564382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:54:59.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086033+0000","last_change":"2023-08-10T10:29:03.441287+0000","last_active":"2023-08-10T10:29:06.086033+0000","last_peered":"2023-08-10T10:29:06.086033+0000","last_clean":"2023-08-10T10:29:06.086033+0000","last_became_active":"2023-08-10T10:29:03.441023+0000","last_became_peered":"2023-08-10T10:29:03.441023+0000","last_unstale":"2023-08-10T10:29:06.086033+0000","last_undegraded":"2023-08-10T10:29:06.086033+0000","last_fullsized":"2023-08-10T10:29:06.086033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435948+0000","last_change":"2023-08-10T10:29:03.442345+0000","last_active":"2023-08-10T10:29:04.435948+0000","last_peered":"2023-08-10T10:29:04.435948+0000","last_clean":"2023-08-10T10:29:04.435948+0000","last_became_active":"2023-08-10T10:29:03.441657+0000","last_became_peered":"2023-08-10T10:29:03.441657+0000","last_unstale":"2023-08-10T10:29:04.435948+0000","last_undegraded":"2023-08-10T10:29:04.435948+0000","last_fullsized":"2023-08-10T10:29:04.435948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086339+0000","last_change":"2023-08-10T10:29:03.447084+0000","last_active":"2023-08-10T10:29:06.086339+0000","last_peered":"2023-08-10T10:29:06.086339+0000","last_clean":"2023-08-10T10:29:06.086339+0000","last_became_active":"2023-08-10T10:29:03.446803+0000","last_became_peered":"2023-08-10T10:29:03.446803+0000","last_unstale":"2023-08-10T10:29:06.086339+0000","last_undegraded":"2023-08-10T10:29:06.086339+0000","last_fullsized":"2023-08-10T10:29:06.086339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454356+0000","last_change":"2023-08-10T10:29:03.449287+0000","last_active":"2023-08-10T10:29:06.454356+0000","last_peered":"2023-08-10T10:29:06.454356+0000","last_clean":"2023-08-10T10:29:06.454356+0000","last_became_active":"2023-08-10T10:29:03.448995+0000","last_became_peered":"2023-08-10T10:29:03.448995+0000","last_unstale":"2023-08-10T10:29:06.454356+0000","last_undegraded":"2023-08-10T10:29:06.454356+0000","last_fullsized":"2023-08-10T10:29:06.454356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:15.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:29:15.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.280+0000 7f68fd7ec700 1 Processor -- start 2023-08-10T10:29:15.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.280+0000 7f68fd7ec700 1 -- start start 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68fd7ec700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68f8154620 0x7f68f80717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68fd7ec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8071d10 0x7f68f806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68fd7ec700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f806e8c0 con 0x7f68f806e480 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68fd7ec700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80c5890 con 0x7f68f8154620 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68fd7ec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f815b290 con 0x7f68f8071d10 2023-08-10T10:29:15.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68f6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68f8154620 0x7f68f80717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68f77fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f68f806e480 0x7f68f815a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37256/0 (socket says 172.21.15.161:37256) 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68f6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68f8154620 0x7f68f80717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60246/0 (socket says 172.21.15.161:60246) 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.281+0000 7f68f77fe700 1 -- 172.21.15.161:0/4186443202 learned_addr learned my addr 172.21.15.161:0/4186443202 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f67fc700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8071d10 0x7f68f806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f6ffd700 1 -- 172.21.15.161:0/4186443202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8071d10 msgr2=0x7f68f806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f6ffd700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8071d10 0x7f68f806df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f6ffd700 1 -- 172.21.15.161:0/4186443202 >> v1:172.21.15.161:6789/0 conn(0x7f68f806e480 legacy=0x7f68f815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f6ffd700 1 -- 172.21.15.161:0/4186443202 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f815b570 con 0x7f68f8154620 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f5ffb700 1 -- 172.21.15.161:0/4186443202 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974336567 0 0) 0x7f68f806e8c0 con 0x7f68f806e480 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f6ffd700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f8154620 0x7f68f80717d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009840 tx=0x7f68ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb793141b54639d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f5ffb700 1 -- 172.21.15.161:0/4186443202 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec011830 con 0x7f68f8154620 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f5ffb700 1 -- 172.21.15.161:0/4186443202 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec011990 con 0x7f68f8154620 2023-08-10T10:29:15.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68f5ffb700 1 -- 172.21.15.161:0/4186443202 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec011d20 con 0x7f68f8154620 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 -- 172.21.15.161:0/4186443202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f8154620 msgr2=0x7f68f80717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f8154620 0x7f68f80717d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009840 tx=0x7f68ec009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 -- 172.21.15.161:0/4186443202 shutdown_connections 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f8154620 0x7f68f80717d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/4186443202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8071d10 0x7f68f806df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 -- 172.21.15.161:0/4186443202 >> 172.21.15.161:0/4186443202 conn(0x7f68f80cfd70 msgr2=0x7f68f80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:15.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.282+0000 7f68fd7ec700 1 -- 172.21.15.161:0/4186443202 shutdown_connections 2023-08-10T10:29:15.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.283+0000 7f68fd7ec700 1 -- 172.21.15.161:0/4186443202 wait complete. 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.284+0000 7f68fd7ec700 1 Processor -- start 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.284+0000 7f68fd7ec700 1 -- start start 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f8071d10 0x7f68f80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8154620 0x7f68f8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80b4540 con 0x7f68f806e480 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80b39c0 con 0x7f68f8071d10 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80b3ca0 con 0x7f68f8154620 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60252/0 (socket says 172.21.15.161:60252) 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 -- 172.21.15.161:0/3121526385 learned_addr learned my addr 172.21.15.161:0/3121526385 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f67fc700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f8071d10 0x7f68f80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f77fe700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8154620 0x7f68f8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 -- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8154620 msgr2=0x7f68f8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8154620 0x7f68f8159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 -- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f8071d10 msgr2=0x7f68f80b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f8071d10 0x7f68f80b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 -- 172.21.15.161:0/3121526385 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0094a0 con 0x7f68f806e480 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68f6ffd700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68ec014040 tx=0x7f68ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0045f0 con 0x7f68f806e480 2023-08-10T10:29:15.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec01e070 con 0x7f68f806e480 2023-08-10T10:29:15.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f80b3f80 con 0x7f68f806e480 2023-08-10T10:29:15.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec003ae0 con 0x7f68f806e480 2023-08-10T10:29:15.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.285+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f80b35f0 con 0x7f68f806e480 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.286+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f80744e0 con 0x7f68f806e480 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.287+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68ec003c40 con 0x7f68f806e480 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.287+0000 7f68df7fe700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 0x7f68e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.287+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68ec08a5e0 con 0x7f68f806e480 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.287+0000 7f68f67fc700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 0x7f68e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.287+0000 7f68f67fc700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 0x7f68e406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68f806f260 tx=0x7f68e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.291+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f68ec055720 con 0x7f68f806e480 2023-08-10T10:29:15.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.479+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68f8070fd0 con 0x7f68e406ace0 2023-08-10T10:29:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.486+0000 7f68df7fe700 1 -- 172.21.15.161:0/3121526385 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286680 (secure 0 0 0) 0x7f68e800a660 con 0x7f68e406ace0 2023-08-10T10:29:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:15.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.489+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 msgr2=0x7f68e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.489+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 0x7f68e406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68f806f260 tx=0x7f68e8008040 comp rx=0 tx=0).stop 2023-08-10T10:29:15.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.489+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 msgr2=0x7f68f80b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.489+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68ec014040 tx=0x7f68ec004750 comp rx=0 tx=0).stop 2023-08-10T10:29:15.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 shutdown_connections 2023-08-10T10:29:15.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f68e406ace0 0x7f68e406d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68f8154620 0x7f68f8159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f806e480 0x7f68f80b52b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 --2- 172.21.15.161:0/3121526385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f8071d10 0x7f68f80b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 >> 172.21.15.161:0/3121526385 conn(0x7f68f80cfd70 msgr2=0x7f68f80d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:15.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 shutdown_connections 2023-08-10T10:29:15.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.490+0000 7f68fd7ec700 1 -- 172.21.15.161:0/3121526385 wait complete. 2023-08-10T10:29:15.497 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:29:15.503 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-10T10:29:14.189300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002417"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431898+0000","last_change":"2023-08-10T10:29:03.444995+0000","last_active":"2023-08-10T10:29:04.431898+0000","last_peered":"2023-08-10T10:29:04.431898+0000","last_clean":"2023-08-10T10:29:04.431898+0000","last_became_active":"2023-08-10T10:29:03.444742+0000","last_became_peered":"2023-08-10T10:29:03.444742+0000","last_unstale":"2023-08-10T10:29:04.431898+0000","last_undegraded":"2023-08-10T10:29:04.431898+0000","last_fullsized":"2023-08-10T10:29:04.431898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:05.950333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344646+0000","last_change":"2023-08-10T10:29:03.450108+0000","last_active":"2023-08-10T10:29:06.344646+0000","last_peered":"2023-08-10T10:29:06.344646+0000","last_clean":"2023-08-10T10:29:06.344646+0000","last_became_active":"2023-08-10T10:29:03.449434+0000","last_became_peered":"2023-08-10T10:29:03.449434+0000","last_unstale":"2023-08-10T10:29:06.344646+0000","last_undegraded":"2023-08-10T10:29:06.344646+0000","last_fullsized":"2023-08-10T10:29:06.344646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:03.644957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435719+0000","last_change":"2023-08-10T10:29:03.449144+0000","last_active":"2023-08-10T10:29:04.435719+0000","last_peered":"2023-08-10T10:29:04.435719+0000","last_clean":"2023-08-10T10:29:04.435719+0000","last_became_active":"2023-08-10T10:29:03.448690+0000","last_became_peered":"2023-08-10T10:29:03.448690+0000","last_unstale":"2023-08-10T10:29:04.435719+0000","last_undegraded":"2023-08-10T10:29:04.435719+0000","last_fullsized":"2023-08-10T10:29:04.435719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564510+0000","last_change":"2023-08-10T10:29:03.448973+0000","last_active":"2023-08-10T10:29:06.564510+0000","last_peered":"2023-08-10T10:29:06.564510+0000","last_clean":"2023-08-10T10:29:06.564510+0000","last_became_active":"2023-08-10T10:29:03.448666+0000","last_became_peered":"2023-08-10T10:29:03.448666+0000","last_unstale":"2023-08-10T10:29:06.564510+0000","last_undegraded":"2023-08-10T10:29:06.564510+0000","last_fullsized":"2023-08-10T10:29:06.564510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:14:38.594843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.795980+0000","last_change":"2023-08-10T10:29:03.451710+0000","last_active":"2023-08-10T10:29:04.795980+0000","last_peered":"2023-08-10T10:29:04.795980+0000","last_clean":"2023-08-10T10:29:04.795980+0000","last_became_active":"2023-08-10T10:29:03.451411+0000","last_became_peered":"2023-08-10T10:29:03.451411+0000","last_unstale":"2023-08-10T10:29:04.795980+0000","last_undegraded":"2023-08-10T10:29:04.795980+0000","last_fullsized":"2023-08-10T10:29:04.795980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435794+0000","last_change":"2023-08-10T10:29:03.451672+0000","last_active":"2023-08-10T10:29:04.435794+0000","last_peered":"2023-08-10T10:29:04.435794+0000","last_clean":"2023-08-10T10:29:04.435794+0000","last_became_active":"2023-08-10T10:29:03.451376+0000","last_became_peered":"2023-08-10T10:29:03.451376+0000","last_unstale":"2023-08-10T10:29:04.435794+0000","last_undegraded":"2023-08-10T10:29:04.435794+0000","last_fullsized":"2023-08-10T10:29:04.435794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440823+0000","last_change":"2023-08-10T10:29:03.444231+0000","last_active":"2023-08-10T10:29:04.440823+0000","last_peered":"2023-08-10T10:29:04.440823+0000","last_clean":"2023-08-10T10:29:04.440823+0000","last_became_active":"2023-08-10T10:29:03.443264+0000","last_became_peered":"2023-08-10T10:29:03.443264+0000","last_unstale":"2023-08-10T10:29:04.440823+0000","last_undegraded":"2023-08-10T10:29:04.440823+0000","last_fullsized":"2023-08-10T10:29:04.440823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344469+0000","last_change":"2023-08-10T10:29:03.447620+0000","last_active":"2023-08-10T10:29:06.344469+0000","last_peered":"2023-08-10T10:29:06.344469+0000","last_clean":"2023-08-10T10:29:06.344469+0000","last_became_active":"2023-08-10T10:29:03.447339+0000","last_became_peered":"2023-08-10T10:29:03.447339+0000","last_unstale":"2023-08-10T10:29:06.344469+0000","last_undegraded":"2023-08-10T10:29:06.344469+0000","last_fullsized":"2023-08-10T10:29:06.344469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796204+0000","last_change":"2023-08-10T10:29:03.450118+0000","last_active":"2023-08-10T10:29:04.796204+0000","last_peered":"2023-08-10T10:29:04.796204+0000","last_clean":"2023-08-10T10:29:04.796204+0000","last_became_active":"2023-08-10T10:29:03.449864+0000","last_became_peered":"2023-08-10T10:29:03.449864+0000","last_unstale":"2023-08-10T10:29:04.796204+0000","last_undegraded":"2023-08-10T10:29:04.796204+0000","last_fullsized":"2023-08-10T10:29:04.796204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344921+0000","last_change":"2023-08-10T10:29:03.451715+0000","last_active":"2023-08-10T10:29:06.344921+0000","last_peered":"2023-08-10T10:29:06.344921+0000","last_clean":"2023-08-10T10:29:06.344921+0000","last_became_active":"2023-08-10T10:29:03.451414+0000","last_became_peered":"2023-08-10T10:29:03.451414+0000","last_unstale":"2023-08-10T10:29:06.344921+0000","last_undegraded":"2023-08-10T10:29:06.344921+0000","last_fullsized":"2023-08-10T10:29:06.344921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435674+0000","last_change":"2023-08-10T10:29:03.443457+0000","last_active":"2023-08-10T10:29:04.435674+0000","last_peered":"2023-08-10T10:29:04.435674+0000","last_clean":"2023-08-10T10:29:04.435674+0000","last_became_active":"2023-08-10T10:29:03.443182+0000","last_became_peered":"2023-08-10T10:29:03.443182+0000","last_unstale":"2023-08-10T10:29:04.435674+0000","last_undegraded":"2023-08-10T10:29:04.435674+0000","last_fullsized":"2023-08-10T10:29:04.435674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:49.149624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432345+0000","last_change":"2023-08-10T10:29:03.443416+0000","last_active":"2023-08-10T10:29:04.432345+0000","last_peered":"2023-08-10T10:29:04.432345+0000","last_clean":"2023-08-10T10:29:04.432345+0000","last_became_active":"2023-08-10T10:29:03.443176+0000","last_became_peered":"2023-08-10T10:29:03.443176+0000","last_unstale":"2023-08-10T10:29:04.432345+0000","last_undegraded":"2023-08-10T10:29:04.432345+0000","last_fullsized":"2023-08-10T10:29:04.432345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:52.006387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431832+0000","last_change":"2023-08-10T10:29:03.445137+0000","last_active":"2023-08-10T10:29:04.431832+0000","last_peered":"2023-08-10T10:29:04.431832+0000","last_clean":"2023-08-10T10:29:04.431832+0000","last_became_active":"2023-08-10T10:29:03.444853+0000","last_became_peered":"2023-08-10T10:29:03.444853+0000","last_unstale":"2023-08-10T10:29:04.431832+0000","last_undegraded":"2023-08-10T10:29:04.431832+0000","last_fullsized":"2023-08-10T10:29:04.431832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:34.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344714+0000","last_change":"2023-08-10T10:29:03.448673+0000","last_active":"2023-08-10T10:29:06.344714+0000","last_peered":"2023-08-10T10:29:06.344714+0000","last_clean":"2023-08-10T10:29:06.344714+0000","last_became_active":"2023-08-10T10:29:03.448378+0000","last_became_peered":"2023-08-10T10:29:03.448378+0000","last_unstale":"2023-08-10T10:29:06.344714+0000","last_undegraded":"2023-08-10T10:29:06.344714+0000","last_fullsized":"2023-08-10T10:29:06.344714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441146+0000","last_change":"2023-08-10T10:29:03.445496+0000","last_active":"2023-08-10T10:29:04.441146+0000","last_peered":"2023-08-10T10:29:04.441146+0000","last_clean":"2023-08-10T10:29:04.441146+0000","last_became_active":"2023-08-10T10:29:03.445239+0000","last_became_peered":"2023-08-10T10:29:03.445239+0000","last_unstale":"2023-08-10T10:29:04.441146+0000","last_undegraded":"2023-08-10T10:29:04.441146+0000","last_fullsized":"2023-08-10T10:29:04.441146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:50.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.451219+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.450957+0000","last_became_peered":"2023-08-10T10:29:03.450957+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:22.072828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796266+0000","last_change":"2023-08-10T10:29:03.450677+0000","last_active":"2023-08-10T10:29:04.796266+0000","last_peered":"2023-08-10T10:29:04.796266+0000","last_clean":"2023-08-10T10:29:04.796266+0000","last_became_active":"2023-08-10T10:29:03.450414+0000","last_became_peered":"2023-08-10T10:29:03.450414+0000","last_unstale":"2023-08-10T10:29:04.796266+0000","last_undegraded":"2023-08-10T10:29:04.796266+0000","last_fullsized":"2023-08-10T10:29:04.796266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435726+0000","last_change":"2023-08-10T10:29:03.448733+0000","last_active":"2023-08-10T10:29:04.435726+0000","last_peered":"2023-08-10T10:29:04.435726+0000","last_clean":"2023-08-10T10:29:04.435726+0000","last_became_active":"2023-08-10T10:29:03.448379+0000","last_became_peered":"2023-08-10T10:29:03.448379+0000","last_unstale":"2023-08-10T10:29:04.435726+0000","last_undegraded":"2023-08-10T10:29:04.435726+0000","last_fullsized":"2023-08-10T10:29:04.435726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431903+0000","last_change":"2023-08-10T10:29:03.445034+0000","last_active":"2023-08-10T10:29:04.431903+0000","last_peered":"2023-08-10T10:29:04.431903+0000","last_clean":"2023-08-10T10:29:04.431903+0000","last_became_active":"2023-08-10T10:29:03.444759+0000","last_became_peered":"2023-08-10T10:29:03.444759+0000","last_unstale":"2023-08-10T10:29:04.431903+0000","last_undegraded":"2023-08-10T10:29:04.431903+0000","last_fullsized":"2023-08-10T10:29:04.431903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:05.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435953+0000","last_change":"2023-08-10T10:29:03.442226+0000","last_active":"2023-08-10T10:29:04.435953+0000","last_peered":"2023-08-10T10:29:04.435953+0000","last_clean":"2023-08-10T10:29:04.435953+0000","last_became_active":"2023-08-10T10:29:03.441986+0000","last_became_peered":"2023-08-10T10:29:03.441986+0000","last_unstale":"2023-08-10T10:29:04.435953+0000","last_undegraded":"2023-08-10T10:29:04.435953+0000","last_fullsized":"2023-08-10T10:29:04.435953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441131+0000","last_change":"2023-08-10T10:29:03.447854+0000","last_active":"2023-08-10T10:29:04.441131+0000","last_peered":"2023-08-10T10:29:04.441131+0000","last_clean":"2023-08-10T10:29:04.441131+0000","last_became_active":"2023-08-10T10:29:03.447513+0000","last_became_peered":"2023-08-10T10:29:03.447513+0000","last_unstale":"2023-08-10T10:29:04.441131+0000","last_undegraded":"2023-08-10T10:29:04.441131+0000","last_fullsized":"2023-08-10T10:29:04.441131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796072+0000","last_change":"2023-08-10T10:29:03.450633+0000","last_active":"2023-08-10T10:29:04.796072+0000","last_peered":"2023-08-10T10:29:04.796072+0000","last_clean":"2023-08-10T10:29:04.796072+0000","last_became_active":"2023-08-10T10:29:03.450345+0000","last_became_peered":"2023-08-10T10:29:03.450345+0000","last_unstale":"2023-08-10T10:29:04.796072+0000","last_undegraded":"2023-08-10T10:29:04.796072+0000","last_fullsized":"2023-08-10T10:29:04.796072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086320+0000","last_change":"2023-08-10T10:29:03.451595+0000","last_active":"2023-08-10T10:29:06.086320+0000","last_peered":"2023-08-10T10:29:06.086320+0000","last_clean":"2023-08-10T10:29:06.086320+0000","last_became_active":"2023-08-10T10:29:03.451277+0000","last_became_peered":"2023-08-10T10:29:03.451277+0000","last_unstale":"2023-08-10T10:29:06.086320+0000","last_undegraded":"2023-08-10T10:29:06.086320+0000","last_fullsized":"2023-08-10T10:29:06.086320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440927+0000","last_change":"2023-08-10T10:29:03.448073+0000","last_active":"2023-08-10T10:29:04.440927+0000","last_peered":"2023-08-10T10:29:04.440927+0000","last_clean":"2023-08-10T10:29:04.440927+0000","last_became_active":"2023-08-10T10:29:03.447608+0000","last_became_peered":"2023-08-10T10:29:03.447608+0000","last_unstale":"2023-08-10T10:29:04.440927+0000","last_undegraded":"2023-08-10T10:29:04.440927+0000","last_fullsized":"2023-08-10T10:29:04.440927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454476+0000","last_change":"2023-08-10T10:29:03.444304+0000","last_active":"2023-08-10T10:29:06.454476+0000","last_peered":"2023-08-10T10:29:06.454476+0000","last_clean":"2023-08-10T10:29:06.454476+0000","last_became_active":"2023-08-10T10:29:03.441797+0000","last_became_peered":"2023-08-10T10:29:03.441797+0000","last_unstale":"2023-08-10T10:29:06.454476+0000","last_undegraded":"2023-08-10T10:29:06.454476+0000","last_fullsized":"2023-08-10T10:29:06.454476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454588+0000","last_change":"2023-08-10T10:29:03.448858+0000","last_active":"2023-08-10T10:29:06.454588+0000","last_peered":"2023-08-10T10:29:06.454588+0000","last_clean":"2023-08-10T10:29:06.454588+0000","last_became_active":"2023-08-10T10:29:03.448575+0000","last_became_peered":"2023-08-10T10:29:03.448575+0000","last_unstale":"2023-08-10T10:29:06.454588+0000","last_undegraded":"2023-08-10T10:29:06.454588+0000","last_fullsized":"2023-08-10T10:29:06.454588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344741+0000","last_change":"2023-08-10T10:29:03.449820+0000","last_active":"2023-08-10T10:29:06.344741+0000","last_peered":"2023-08-10T10:29:06.344741+0000","last_clean":"2023-08-10T10:29:06.344741+0000","last_became_active":"2023-08-10T10:29:03.449280+0000","last_became_peered":"2023-08-10T10:29:03.449280+0000","last_unstale":"2023-08-10T10:29:06.344741+0000","last_undegraded":"2023-08-10T10:29:06.344741+0000","last_fullsized":"2023-08-10T10:29:06.344741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436273+0000","last_change":"2023-08-10T10:29:02.509556+0000","last_active":"2023-08-10T10:29:04.436273+0000","last_peered":"2023-08-10T10:29:04.436273+0000","last_clean":"2023-08-10T10:29:04.436273+0000","last_became_active":"2023-08-10T10:29:02.509283+0000","last_became_peered":"2023-08-10T10:29:02.509283+0000","last_unstale":"2023-08-10T10:29:04.436273+0000","last_undegraded":"2023-08-10T10:29:04.436273+0000","last_fullsized":"2023-08-10T10:29:04.436273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086441+0000","last_change":"2023-08-10T10:29:03.443570+0000","last_active":"2023-08-10T10:29:06.086441+0000","last_peered":"2023-08-10T10:29:06.086441+0000","last_clean":"2023-08-10T10:29:06.086441+0000","last_became_active":"2023-08-10T10:29:03.443302+0000","last_became_peered":"2023-08-10T10:29:03.443302+0000","last_unstale":"2023-08-10T10:29:06.086441+0000","last_undegraded":"2023-08-10T10:29:06.086441+0000","last_fullsized":"2023-08-10T10:29:06.086441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454280+0000","last_change":"2023-08-10T10:29:02.510076+0000","last_active":"2023-08-10T10:29:06.454280+0000","last_peered":"2023-08-10T10:29:06.454280+0000","last_clean":"2023-08-10T10:29:06.454280+0000","last_became_active":"2023-08-10T10:29:02.509806+0000","last_became_peered":"2023-08-10T10:29:02.509806+0000","last_unstale":"2023-08-10T10:29:06.454280+0000","last_undegraded":"2023-08-10T10:29:06.454280+0000","last_fullsized":"2023-08-10T10:29:06.454280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796264+0000","last_change":"2023-08-10T10:29:03.450711+0000","last_active":"2023-08-10T10:29:04.796264+0000","last_peered":"2023-08-10T10:29:04.796264+0000","last_clean":"2023-08-10T10:29:04.796264+0000","last_became_active":"2023-08-10T10:29:03.450363+0000","last_became_peered":"2023-08-10T10:29:03.450363+0000","last_unstale":"2023-08-10T10:29:04.796264+0000","last_undegraded":"2023-08-10T10:29:04.796264+0000","last_fullsized":"2023-08-10T10:29:04.796264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086179+0000","last_change":"2023-08-10T10:29:02.509352+0000","last_active":"2023-08-10T10:29:06.086179+0000","last_peered":"2023-08-10T10:29:06.086179+0000","last_clean":"2023-08-10T10:29:06.086179+0000","last_became_active":"2023-08-10T10:29:02.509050+0000","last_became_peered":"2023-08-10T10:29:02.509050+0000","last_unstale":"2023-08-10T10:29:06.086179+0000","last_undegraded":"2023-08-10T10:29:06.086179+0000","last_fullsized":"2023-08-10T10:29:06.086179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:03.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564688+0000","last_change":"2023-08-10T10:29:03.449521+0000","last_active":"2023-08-10T10:29:06.564688+0000","last_peered":"2023-08-10T10:29:06.564688+0000","last_clean":"2023-08-10T10:29:06.564688+0000","last_became_active":"2023-08-10T10:29:03.449254+0000","last_became_peered":"2023-08-10T10:29:03.449254+0000","last_unstale":"2023-08-10T10:29:06.564688+0000","last_undegraded":"2023-08-10T10:29:06.564688+0000","last_fullsized":"2023-08-10T10:29:06.564688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:52.435268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796291+0000","last_change":"2023-08-10T10:29:02.514169+0000","last_active":"2023-08-10T10:29:04.796291+0000","last_peered":"2023-08-10T10:29:04.796291+0000","last_clean":"2023-08-10T10:29:04.796291+0000","last_became_active":"2023-08-10T10:29:02.513967+0000","last_became_peered":"2023-08-10T10:29:02.513967+0000","last_unstale":"2023-08-10T10:29:04.796291+0000","last_undegraded":"2023-08-10T10:29:04.796291+0000","last_fullsized":"2023-08-10T10:29:04.796291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086126+0000","last_change":"2023-08-10T10:29:03.440626+0000","last_active":"2023-08-10T10:29:06.086126+0000","last_peered":"2023-08-10T10:29:06.086126+0000","last_clean":"2023-08-10T10:29:06.086126+0000","last_became_active":"2023-08-10T10:29:03.440266+0000","last_became_peered":"2023-08-10T10:29:03.440266+0000","last_unstale":"2023-08-10T10:29:06.086126+0000","last_undegraded":"2023-08-10T10:29:06.086126+0000","last_fullsized":"2023-08-10T10:29:06.086126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344756+0000","last_change":"2023-08-10T10:29:02.505024+0000","last_active":"2023-08-10T10:29:06.344756+0000","last_peered":"2023-08-10T10:29:06.344756+0000","last_clean":"2023-08-10T10:29:06.344756+0000","last_became_active":"2023-08-10T10:29:02.504178+0000","last_became_peered":"2023-08-10T10:29:02.504178+0000","last_unstale":"2023-08-10T10:29:06.344756+0000","last_undegraded":"2023-08-10T10:29:06.344756+0000","last_fullsized":"2023-08-10T10:29:06.344756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:18.093416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086183+0000","last_change":"2023-08-10T10:29:03.444252+0000","last_active":"2023-08-10T10:29:06.086183+0000","last_peered":"2023-08-10T10:29:06.086183+0000","last_clean":"2023-08-10T10:29:06.086183+0000","last_became_active":"2023-08-10T10:29:03.443982+0000","last_became_peered":"2023-08-10T10:29:03.443982+0000","last_unstale":"2023-08-10T10:29:06.086183+0000","last_undegraded":"2023-08-10T10:29:06.086183+0000","last_fullsized":"2023-08-10T10:29:06.086183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441209+0000","last_change":"2023-08-10T10:29:02.510256+0000","last_active":"2023-08-10T10:29:04.441209+0000","last_peered":"2023-08-10T10:29:04.441209+0000","last_clean":"2023-08-10T10:29:04.441209+0000","last_became_active":"2023-08-10T10:29:02.510054+0000","last_became_peered":"2023-08-10T10:29:02.510054+0000","last_unstale":"2023-08-10T10:29:04.441209+0000","last_undegraded":"2023-08-10T10:29:04.441209+0000","last_fullsized":"2023-08-10T10:29:04.441209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:03.509285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454279+0000","last_change":"2023-08-10T10:29:03.442886+0000","last_active":"2023-08-10T10:29:06.454279+0000","last_peered":"2023-08-10T10:29:06.454279+0000","last_clean":"2023-08-10T10:29:06.454279+0000","last_became_active":"2023-08-10T10:29:03.442103+0000","last_became_peered":"2023-08-10T10:29:03.442103+0000","last_unstale":"2023-08-10T10:29:06.454279+0000","last_undegraded":"2023-08-10T10:29:06.454279+0000","last_fullsized":"2023-08-10T10:29:06.454279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436220+0000","last_change":"2023-08-10T10:29:02.504354+0000","last_active":"2023-08-10T10:29:04.436220+0000","last_peered":"2023-08-10T10:29:04.436220+0000","last_clean":"2023-08-10T10:29:04.436220+0000","last_became_active":"2023-08-10T10:29:02.503879+0000","last_became_peered":"2023-08-10T10:29:02.503879+0000","last_unstale":"2023-08-10T10:29:04.436220+0000","last_undegraded":"2023-08-10T10:29:04.436220+0000","last_fullsized":"2023-08-10T10:29:04.436220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436378+0000","last_change":"2023-08-10T10:29:03.440803+0000","last_active":"2023-08-10T10:29:04.436378+0000","last_peered":"2023-08-10T10:29:04.436378+0000","last_clean":"2023-08-10T10:29:04.436378+0000","last_became_active":"2023-08-10T10:29:03.440491+0000","last_became_peered":"2023-08-10T10:29:03.440491+0000","last_unstale":"2023-08-10T10:29:04.436378+0000","last_undegraded":"2023-08-10T10:29:04.436378+0000","last_fullsized":"2023-08-10T10:29:04.436378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:04.510976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441036+0000","last_change":"2023-08-10T10:29:02.506354+0000","last_active":"2023-08-10T10:29:04.441036+0000","last_peered":"2023-08-10T10:29:04.441036+0000","last_clean":"2023-08-10T10:29:04.441036+0000","last_became_active":"2023-08-10T10:29:02.506110+0000","last_became_peered":"2023-08-10T10:29:02.506110+0000","last_unstale":"2023-08-10T10:29:04.441036+0000","last_undegraded":"2023-08-10T10:29:04.441036+0000","last_fullsized":"2023-08-10T10:29:04.441036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.953593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086288+0000","last_change":"2023-08-10T10:29:03.443853+0000","last_active":"2023-08-10T10:29:06.086288+0000","last_peered":"2023-08-10T10:29:06.086288+0000","last_clean":"2023-08-10T10:29:06.086288+0000","last_became_active":"2023-08-10T10:29:03.443591+0000","last_became_peered":"2023-08-10T10:29:03.443591+0000","last_unstale":"2023-08-10T10:29:06.086288+0000","last_undegraded":"2023-08-10T10:29:06.086288+0000","last_fullsized":"2023-08-10T10:29:06.086288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796014+0000","last_change":"2023-08-10T10:29:02.508938+0000","last_active":"2023-08-10T10:29:04.796014+0000","last_peered":"2023-08-10T10:29:04.796014+0000","last_clean":"2023-08-10T10:29:04.796014+0000","last_became_active":"2023-08-10T10:29:02.508669+0000","last_became_peered":"2023-08-10T10:29:02.508669+0000","last_unstale":"2023-08-10T10:29:04.796014+0000","last_undegraded":"2023-08-10T10:29:04.796014+0000","last_fullsized":"2023-08-10T10:29:04.796014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:31:51.433577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344680+0000","last_change":"2023-08-10T10:29:03.450335+0000","last_active":"2023-08-10T10:29:06.344680+0000","last_peered":"2023-08-10T10:29:06.344680+0000","last_clean":"2023-08-10T10:29:06.344680+0000","last_became_active":"2023-08-10T10:29:03.449118+0000","last_became_peered":"2023-08-10T10:29:03.449118+0000","last_unstale":"2023-08-10T10:29:06.344680+0000","last_undegraded":"2023-08-10T10:29:06.344680+0000","last_fullsized":"2023-08-10T10:29:06.344680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440904+0000","last_change":"2023-08-10T10:29:02.508190+0000","last_active":"2023-08-10T10:29:04.440904+0000","last_peered":"2023-08-10T10:29:04.440904+0000","last_clean":"2023-08-10T10:29:04.440904+0000","last_became_active":"2023-08-10T10:29:02.507882+0000","last_became_peered":"2023-08-10T10:29:02.507882+0000","last_unstale":"2023-08-10T10:29:04.440904+0000","last_undegraded":"2023-08-10T10:29:04.440904+0000","last_fullsized":"2023-08-10T10:29:04.440904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796210+0000","last_change":"2023-08-10T10:29:03.448316+0000","last_active":"2023-08-10T10:29:04.796210+0000","last_peered":"2023-08-10T10:29:04.796210+0000","last_clean":"2023-08-10T10:29:04.796210+0000","last_became_active":"2023-08-10T10:29:03.447711+0000","last_became_peered":"2023-08-10T10:29:03.447711+0000","last_unstale":"2023-08-10T10:29:04.796210+0000","last_undegraded":"2023-08-10T10:29:04.796210+0000","last_fullsized":"2023-08-10T10:29:04.796210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564253+0000","last_change":"2023-08-10T10:29:02.508683+0000","last_active":"2023-08-10T10:29:06.564253+0000","last_peered":"2023-08-10T10:29:06.564253+0000","last_clean":"2023-08-10T10:29:06.564253+0000","last_became_active":"2023-08-10T10:29:02.508399+0000","last_became_peered":"2023-08-10T10:29:02.508399+0000","last_unstale":"2023-08-10T10:29:06.564253+0000","last_undegraded":"2023-08-10T10:29:06.564253+0000","last_fullsized":"2023-08-10T10:29:06.564253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:45.110488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086773+0000","last_change":"2023-08-10T10:29:03.444878+0000","last_active":"2023-08-10T10:29:06.086773+0000","last_peered":"2023-08-10T10:29:06.086773+0000","last_clean":"2023-08-10T10:29:06.086773+0000","last_became_active":"2023-08-10T10:29:03.444560+0000","last_became_peered":"2023-08-10T10:29:03.444560+0000","last_unstale":"2023-08-10T10:29:06.086773+0000","last_undegraded":"2023-08-10T10:29:06.086773+0000","last_fullsized":"2023-08-10T10:29:06.086773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:29.412037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441325+0000","last_change":"2023-08-10T10:29:02.506132+0000","last_active":"2023-08-10T10:29:04.441325+0000","last_peered":"2023-08-10T10:29:04.441325+0000","last_clean":"2023-08-10T10:29:04.441325+0000","last_became_active":"2023-08-10T10:29:02.505862+0000","last_became_peered":"2023-08-10T10:29:02.505862+0000","last_unstale":"2023-08-10T10:29:04.441325+0000","last_undegraded":"2023-08-10T10:29:04.441325+0000","last_fullsized":"2023-08-10T10:29:04.441325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:53.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344467+0000","last_change":"2023-08-10T10:29:03.448717+0000","last_active":"2023-08-10T10:29:06.344467+0000","last_peered":"2023-08-10T10:29:06.344467+0000","last_clean":"2023-08-10T10:29:06.344467+0000","last_became_active":"2023-08-10T10:29:03.448231+0000","last_became_peered":"2023-08-10T10:29:03.448231+0000","last_unstale":"2023-08-10T10:29:06.344467+0000","last_undegraded":"2023-08-10T10:29:06.344467+0000","last_fullsized":"2023-08-10T10:29:06.344467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:04.899551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441232+0000","last_change":"2023-08-10T10:29:02.503467+0000","last_active":"2023-08-10T10:29:04.441232+0000","last_peered":"2023-08-10T10:29:04.441232+0000","last_clean":"2023-08-10T10:29:04.441232+0000","last_became_active":"2023-08-10T10:29:02.503095+0000","last_became_peered":"2023-08-10T10:29:02.503095+0000","last_unstale":"2023-08-10T10:29:04.441232+0000","last_undegraded":"2023-08-10T10:29:04.441232+0000","last_fullsized":"2023-08-10T10:29:04.441232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:52.156146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435432+0000","last_change":"2023-08-10T10:29:03.443580+0000","last_active":"2023-08-10T10:29:04.435432+0000","last_peered":"2023-08-10T10:29:04.435432+0000","last_clean":"2023-08-10T10:29:04.435432+0000","last_became_active":"2023-08-10T10:29:03.443304+0000","last_became_peered":"2023-08-10T10:29:03.443304+0000","last_unstale":"2023-08-10T10:29:04.435432+0000","last_undegraded":"2023-08-10T10:29:04.435432+0000","last_fullsized":"2023-08-10T10:29:04.435432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441314+0000","last_change":"2023-08-10T10:29:02.508008+0000","last_active":"2023-08-10T10:29:04.441314+0000","last_peered":"2023-08-10T10:29:04.441314+0000","last_clean":"2023-08-10T10:29:04.441314+0000","last_became_active":"2023-08-10T10:29:02.507657+0000","last_became_peered":"2023-08-10T10:29:02.507657+0000","last_unstale":"2023-08-10T10:29:04.441314+0000","last_undegraded":"2023-08-10T10:29:04.441314+0000","last_fullsized":"2023-08-10T10:29:04.441314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:55.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564606+0000","last_change":"2023-08-10T10:29:03.440621+0000","last_active":"2023-08-10T10:29:06.564606+0000","last_peered":"2023-08-10T10:29:06.564606+0000","last_clean":"2023-08-10T10:29:06.564606+0000","last_became_active":"2023-08-10T10:29:03.440332+0000","last_became_peered":"2023-08-10T10:29:03.440332+0000","last_unstale":"2023-08-10T10:29:06.564606+0000","last_undegraded":"2023-08-10T10:29:06.564606+0000","last_fullsized":"2023-08-10T10:29:06.564606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.181024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344711+0000","last_change":"2023-08-10T10:29:02.509818+0000","last_active":"2023-08-10T10:29:06.344711+0000","last_peered":"2023-08-10T10:29:06.344711+0000","last_clean":"2023-08-10T10:29:06.344711+0000","last_became_active":"2023-08-10T10:29:02.509518+0000","last_became_peered":"2023-08-10T10:29:02.509518+0000","last_unstale":"2023-08-10T10:29:06.344711+0000","last_undegraded":"2023-08-10T10:29:06.344711+0000","last_fullsized":"2023-08-10T10:29:06.344711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796348+0000","last_change":"2023-08-10T10:29:03.447884+0000","last_active":"2023-08-10T10:29:04.796348+0000","last_peered":"2023-08-10T10:29:04.796348+0000","last_clean":"2023-08-10T10:29:04.796348+0000","last_became_active":"2023-08-10T10:29:03.447609+0000","last_became_peered":"2023-08-10T10:29:03.447609+0000","last_unstale":"2023-08-10T10:29:04.796348+0000","last_undegraded":"2023-08-10T10:29:04.796348+0000","last_fullsized":"2023-08-10T10:29:04.796348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086361+0000","last_change":"2023-08-10T10:29:02.508827+0000","last_active":"2023-08-10T10:29:06.086361+0000","last_peered":"2023-08-10T10:29:06.086361+0000","last_clean":"2023-08-10T10:29:06.086361+0000","last_became_active":"2023-08-10T10:29:02.508532+0000","last_became_peered":"2023-08-10T10:29:02.508532+0000","last_unstale":"2023-08-10T10:29:06.086361+0000","last_undegraded":"2023-08-10T10:29:06.086361+0000","last_fullsized":"2023-08-10T10:29:06.086361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:02.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436080+0000","last_change":"2023-08-10T10:29:03.442543+0000","last_active":"2023-08-10T10:29:04.436080+0000","last_peered":"2023-08-10T10:29:04.436080+0000","last_clean":"2023-08-10T10:29:04.436080+0000","last_became_active":"2023-08-10T10:29:03.439760+0000","last_became_peered":"2023-08-10T10:29:03.439760+0000","last_unstale":"2023-08-10T10:29:04.436080+0000","last_undegraded":"2023-08-10T10:29:04.436080+0000","last_fullsized":"2023-08-10T10:29:04.436080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564433+0000","last_change":"2023-08-10T10:29:02.511617+0000","last_active":"2023-08-10T10:29:06.564433+0000","last_peered":"2023-08-10T10:29:06.564433+0000","last_clean":"2023-08-10T10:29:06.564433+0000","last_became_active":"2023-08-10T10:29:02.511332+0000","last_became_peered":"2023-08-10T10:29:02.511332+0000","last_unstale":"2023-08-10T10:29:06.564433+0000","last_undegraded":"2023-08-10T10:29:06.564433+0000","last_fullsized":"2023-08-10T10:29:06.564433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:42.078663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435889+0000","last_change":"2023-08-10T10:29:03.438600+0000","last_active":"2023-08-10T10:29:04.435889+0000","last_peered":"2023-08-10T10:29:04.435889+0000","last_clean":"2023-08-10T10:29:04.435889+0000","last_became_active":"2023-08-10T10:29:03.438329+0000","last_became_peered":"2023-08-10T10:29:03.438329+0000","last_unstale":"2023-08-10T10:29:04.435889+0000","last_undegraded":"2023-08-10T10:29:04.435889+0000","last_fullsized":"2023-08-10T10:29:04.435889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:11.906108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435725+0000","last_change":"2023-08-10T10:29:02.501143+0000","last_active":"2023-08-10T10:29:04.435725+0000","last_peered":"2023-08-10T10:29:04.435725+0000","last_clean":"2023-08-10T10:29:04.435725+0000","last_became_active":"2023-08-10T10:29:02.500734+0000","last_became_peered":"2023-08-10T10:29:02.500734+0000","last_unstale":"2023-08-10T10:29:04.435725+0000","last_undegraded":"2023-08-10T10:29:04.435725+0000","last_fullsized":"2023-08-10T10:29:04.435725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:43.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435945+0000","last_change":"2023-08-10T10:29:03.441585+0000","last_active":"2023-08-10T10:29:04.435945+0000","last_peered":"2023-08-10T10:29:04.435945+0000","last_clean":"2023-08-10T10:29:04.435945+0000","last_became_active":"2023-08-10T10:29:03.441315+0000","last_became_peered":"2023-08-10T10:29:03.441315+0000","last_unstale":"2023-08-10T10:29:04.435945+0000","last_undegraded":"2023-08-10T10:29:04.435945+0000","last_fullsized":"2023-08-10T10:29:04.435945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:25.676583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086015+0000","last_change":"2023-08-10T10:29:02.509843+0000","last_active":"2023-08-10T10:29:06.086015+0000","last_peered":"2023-08-10T10:29:06.086015+0000","last_clean":"2023-08-10T10:29:06.086015+0000","last_became_active":"2023-08-10T10:29:02.509581+0000","last_became_peered":"2023-08-10T10:29:02.509581+0000","last_unstale":"2023-08-10T10:29:06.086015+0000","last_undegraded":"2023-08-10T10:29:06.086015+0000","last_fullsized":"2023-08-10T10:29:06.086015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:48.147933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454594+0000","last_change":"2023-08-10T10:29:03.447663+0000","last_active":"2023-08-10T10:29:06.454594+0000","last_peered":"2023-08-10T10:29:06.454594+0000","last_clean":"2023-08-10T10:29:06.454594+0000","last_became_active":"2023-08-10T10:29:03.447249+0000","last_became_peered":"2023-08-10T10:29:03.447249+0000","last_unstale":"2023-08-10T10:29:06.454594+0000","last_undegraded":"2023-08-10T10:29:06.454594+0000","last_fullsized":"2023-08-10T10:29:06.454594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.453942+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:06.453942+0000","last_peered":"2023-08-10T10:29:06.453942+0000","last_clean":"2023-08-10T10:29:06.453942+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:06.453942+0000","last_undegraded":"2023-08-10T10:29:06.453942+0000","last_fullsized":"2023-08-10T10:29:06.453942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:30.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344840+0000","last_change":"2023-08-10T10:29:02.509950+0000","last_active":"2023-08-10T10:29:06.344840+0000","last_peered":"2023-08-10T10:29:06.344840+0000","last_clean":"2023-08-10T10:29:06.344840+0000","last_became_active":"2023-08-10T10:29:02.509612+0000","last_became_peered":"2023-08-10T10:29:02.509612+0000","last_unstale":"2023-08-10T10:29:06.344840+0000","last_undegraded":"2023-08-10T10:29:06.344840+0000","last_fullsized":"2023-08-10T10:29:06.344840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454290+0000","last_change":"2023-08-10T10:29:03.448544+0000","last_active":"2023-08-10T10:29:06.454290+0000","last_peered":"2023-08-10T10:29:06.454290+0000","last_clean":"2023-08-10T10:29:06.454290+0000","last_became_active":"2023-08-10T10:29:03.448140+0000","last_became_peered":"2023-08-10T10:29:03.448140+0000","last_unstale":"2023-08-10T10:29:06.454290+0000","last_undegraded":"2023-08-10T10:29:06.454290+0000","last_fullsized":"2023-08-10T10:29:06.454290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344627+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:06.344627+0000","last_peered":"2023-08-10T10:29:06.344627+0000","last_clean":"2023-08-10T10:29:06.344627+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:06.344627+0000","last_undegraded":"2023-08-10T10:29:06.344627+0000","last_fullsized":"2023-08-10T10:29:06.344627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:39.055486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436302+0000","last_change":"2023-08-10T10:29:02.508916+0000","last_active":"2023-08-10T10:29:04.436302+0000","last_peered":"2023-08-10T10:29:04.436302+0000","last_clean":"2023-08-10T10:29:04.436302+0000","last_became_active":"2023-08-10T10:29:02.508630+0000","last_became_peered":"2023-08-10T10:29:02.508630+0000","last_unstale":"2023-08-10T10:29:04.436302+0000","last_undegraded":"2023-08-10T10:29:04.436302+0000","last_fullsized":"2023-08-10T10:29:04.436302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:28.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454399+0000","last_change":"2023-08-10T10:29:03.449910+0000","last_active":"2023-08-10T10:29:06.454399+0000","last_peered":"2023-08-10T10:29:06.454399+0000","last_clean":"2023-08-10T10:29:06.454399+0000","last_became_active":"2023-08-10T10:29:03.449231+0000","last_became_peered":"2023-08-10T10:29:03.449231+0000","last_unstale":"2023-08-10T10:29:06.454399+0000","last_undegraded":"2023-08-10T10:29:06.454399+0000","last_fullsized":"2023-08-10T10:29:06.454399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:44.242545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.431730+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:29:04.431730+0000","last_peered":"2023-08-10T10:29:04.431730+0000","last_clean":"2023-08-10T10:29:04.431730+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:29:04.431730+0000","last_undegraded":"2023-08-10T10:29:04.431730+0000","last_fullsized":"2023-08-10T10:29:04.431730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:28.646905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454065+0000","last_change":"2023-08-10T10:29:02.506926+0000","last_active":"2023-08-10T10:29:06.454065+0000","last_peered":"2023-08-10T10:29:06.454065+0000","last_clean":"2023-08-10T10:29:06.454065+0000","last_became_active":"2023-08-10T10:29:02.506687+0000","last_became_peered":"2023-08-10T10:29:02.506687+0000","last_unstale":"2023-08-10T10:29:06.454065+0000","last_undegraded":"2023-08-10T10:29:06.454065+0000","last_fullsized":"2023-08-10T10:29:06.454065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454532+0000","last_change":"2023-08-10T10:29:03.450582+0000","last_active":"2023-08-10T10:29:06.454532+0000","last_peered":"2023-08-10T10:29:06.454532+0000","last_clean":"2023-08-10T10:29:06.454532+0000","last_became_active":"2023-08-10T10:29:03.450087+0000","last_became_peered":"2023-08-10T10:29:03.450087+0000","last_unstale":"2023-08-10T10:29:06.454532+0000","last_undegraded":"2023-08-10T10:29:06.454532+0000","last_fullsized":"2023-08-10T10:29:06.454532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:25.959678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344340+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:06.344340+0000","last_peered":"2023-08-10T10:29:06.344340+0000","last_clean":"2023-08-10T10:29:06.344340+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:06.344340+0000","last_undegraded":"2023-08-10T10:29:06.344340+0000","last_fullsized":"2023-08-10T10:29:06.344340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:43.417388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440678+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:04.440678+0000","last_peered":"2023-08-10T10:29:04.440678+0000","last_clean":"2023-08-10T10:29:04.440678+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:04.440678+0000","last_undegraded":"2023-08-10T10:29:04.440678+0000","last_fullsized":"2023-08-10T10:29:04.440678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:15.475871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086186+0000","last_change":"2023-08-10T10:29:02.509636+0000","last_active":"2023-08-10T10:29:06.086186+0000","last_peered":"2023-08-10T10:29:06.086186+0000","last_clean":"2023-08-10T10:29:06.086186+0000","last_became_active":"2023-08-10T10:29:02.509357+0000","last_became_peered":"2023-08-10T10:29:02.509357+0000","last_unstale":"2023-08-10T10:29:06.086186+0000","last_undegraded":"2023-08-10T10:29:06.086186+0000","last_fullsized":"2023-08-10T10:29:06.086186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:10.904417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564564+0000","last_change":"2023-08-10T10:29:03.443731+0000","last_active":"2023-08-10T10:29:06.564564+0000","last_peered":"2023-08-10T10:29:06.564564+0000","last_clean":"2023-08-10T10:29:06.564564+0000","last_became_active":"2023-08-10T10:29:03.443369+0000","last_became_peered":"2023-08-10T10:29:03.443369+0000","last_unstale":"2023-08-10T10:29:06.564564+0000","last_undegraded":"2023-08-10T10:29:06.564564+0000","last_fullsized":"2023-08-10T10:29:06.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:14.287109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.440834+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:04.440834+0000","last_peered":"2023-08-10T10:29:04.440834+0000","last_clean":"2023-08-10T10:29:04.440834+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:04.440834+0000","last_undegraded":"2023-08-10T10:29:04.440834+0000","last_fullsized":"2023-08-10T10:29:04.440834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796044+0000","last_change":"2023-08-10T10:29:02.508404+0000","last_active":"2023-08-10T10:29:04.796044+0000","last_peered":"2023-08-10T10:29:04.796044+0000","last_clean":"2023-08-10T10:29:04.796044+0000","last_became_active":"2023-08-10T10:29:02.508118+0000","last_became_peered":"2023-08-10T10:29:02.508118+0000","last_unstale":"2023-08-10T10:29:04.796044+0000","last_undegraded":"2023-08-10T10:29:04.796044+0000","last_fullsized":"2023-08-10T10:29:04.796044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:21.071137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796403+0000","last_change":"2023-08-10T10:29:03.449361+0000","last_active":"2023-08-10T10:29:04.796403+0000","last_peered":"2023-08-10T10:29:04.796403+0000","last_clean":"2023-08-10T10:29:04.796403+0000","last_became_active":"2023-08-10T10:29:03.448855+0000","last_became_peered":"2023-08-10T10:29:03.448855+0000","last_unstale":"2023-08-10T10:29:04.796403+0000","last_undegraded":"2023-08-10T10:29:04.796403+0000","last_fullsized":"2023-08-10T10:29:04.796403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.441134+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:04.441134+0000","last_peered":"2023-08-10T10:29:04.441134+0000","last_clean":"2023-08-10T10:29:04.441134+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:04.441134+0000","last_undegraded":"2023-08-10T10:29:04.441134+0000","last_fullsized":"2023-08-10T10:29:04.441134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:24.224979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454493+0000","last_change":"2023-08-10T10:29:02.507620+0000","last_active":"2023-08-10T10:29:06.454493+0000","last_peered":"2023-08-10T10:29:06.454493+0000","last_clean":"2023-08-10T10:29:06.454493+0000","last_became_active":"2023-08-10T10:29:02.507334+0000","last_became_peered":"2023-08-10T10:29:02.507334+0000","last_unstale":"2023-08-10T10:29:06.454493+0000","last_undegraded":"2023-08-10T10:29:06.454493+0000","last_fullsized":"2023-08-10T10:29:06.454493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796133+0000","last_change":"2023-08-10T10:29:03.451179+0000","last_active":"2023-08-10T10:29:04.796133+0000","last_peered":"2023-08-10T10:29:04.796133+0000","last_clean":"2023-08-10T10:29:04.796133+0000","last_became_active":"2023-08-10T10:29:03.450918+0000","last_became_peered":"2023-08-10T10:29:03.450918+0000","last_unstale":"2023-08-10T10:29:04.796133+0000","last_undegraded":"2023-08-10T10:29:04.796133+0000","last_fullsized":"2023-08-10T10:29:04.796133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:35.521951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086651+0000","last_change":"2023-08-10T10:29:02.509567+0000","last_active":"2023-08-10T10:29:06.086651+0000","last_peered":"2023-08-10T10:29:06.086651+0000","last_clean":"2023-08-10T10:29:06.086651+0000","last_became_active":"2023-08-10T10:29:02.509227+0000","last_became_peered":"2023-08-10T10:29:02.509227+0000","last_unstale":"2023-08-10T10:29:06.086651+0000","last_undegraded":"2023-08-10T10:29:06.086651+0000","last_fullsized":"2023-08-10T10:29:06.086651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454598+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:06.454598+0000","last_peered":"2023-08-10T10:29:06.454598+0000","last_clean":"2023-08-10T10:29:06.454598+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:06.454598+0000","last_undegraded":"2023-08-10T10:29:06.454598+0000","last_fullsized":"2023-08-10T10:29:06.454598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:58.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.085979+0000","last_change":"2023-08-10T10:29:03.445049+0000","last_active":"2023-08-10T10:29:06.085979+0000","last_peered":"2023-08-10T10:29:06.085979+0000","last_clean":"2023-08-10T10:29:06.085979+0000","last_became_active":"2023-08-10T10:29:03.444724+0000","last_became_peered":"2023-08-10T10:29:03.444724+0000","last_unstale":"2023-08-10T10:29:06.085979+0000","last_undegraded":"2023-08-10T10:29:06.085979+0000","last_fullsized":"2023-08-10T10:29:06.085979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564247+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:06.564247+0000","last_peered":"2023-08-10T10:29:06.564247+0000","last_clean":"2023-08-10T10:29:06.564247+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:06.564247+0000","last_undegraded":"2023-08-10T10:29:06.564247+0000","last_fullsized":"2023-08-10T10:29:06.564247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:51.252030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.208517+0000","last_change":"2023-08-10T10:29:02.508685+0000","last_active":"2023-08-10T10:29:06.208517+0000","last_peered":"2023-08-10T10:29:06.208517+0000","last_clean":"2023-08-10T10:29:06.208517+0000","last_became_active":"2023-08-10T10:29:02.508376+0000","last_became_peered":"2023-08-10T10:29:02.508376+0000","last_unstale":"2023-08-10T10:29:06.208517+0000","last_undegraded":"2023-08-10T10:29:06.208517+0000","last_fullsized":"2023-08-10T10:29:06.208517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:42:24.674892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435479+0000","last_change":"2023-08-10T10:29:03.449122+0000","last_active":"2023-08-10T10:29:04.435479+0000","last_peered":"2023-08-10T10:29:04.435479+0000","last_clean":"2023-08-10T10:29:04.435479+0000","last_became_active":"2023-08-10T10:29:03.448040+0000","last_became_peered":"2023-08-10T10:29:03.448040+0000","last_unstale":"2023-08-10T10:29:04.435479+0000","last_undegraded":"2023-08-10T10:29:04.435479+0000","last_fullsized":"2023-08-10T10:29:04.435479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:32.718271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796191+0000","last_change":"2023-08-10T10:29:02.511445+0000","last_active":"2023-08-10T10:29:04.796191+0000","last_peered":"2023-08-10T10:29:04.796191+0000","last_clean":"2023-08-10T10:29:04.796191+0000","last_became_active":"2023-08-10T10:29:02.511184+0000","last_became_peered":"2023-08-10T10:29:02.511184+0000","last_unstale":"2023-08-10T10:29:04.796191+0000","last_undegraded":"2023-08-10T10:29:04.796191+0000","last_fullsized":"2023-08-10T10:29:04.796191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:31.716581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.432195+0000","last_change":"2023-08-10T10:29:03.444198+0000","last_active":"2023-08-10T10:29:04.432195+0000","last_peered":"2023-08-10T10:29:04.432195+0000","last_clean":"2023-08-10T10:29:04.432195+0000","last_became_active":"2023-08-10T10:29:03.443273+0000","last_became_peered":"2023-08-10T10:29:03.443273+0000","last_unstale":"2023-08-10T10:29:04.432195+0000","last_undegraded":"2023-08-10T10:29:04.432195+0000","last_fullsized":"2023-08-10T10:29:04.432195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:29.940510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344717+0000","last_change":"2023-08-10T10:29:02.506009+0000","last_active":"2023-08-10T10:29:06.344717+0000","last_peered":"2023-08-10T10:29:06.344717+0000","last_clean":"2023-08-10T10:29:06.344717+0000","last_became_active":"2023-08-10T10:29:02.505751+0000","last_became_peered":"2023-08-10T10:29:02.505751+0000","last_unstale":"2023-08-10T10:29:06.344717+0000","last_undegraded":"2023-08-10T10:29:06.344717+0000","last_fullsized":"2023-08-10T10:29:06.344717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:54.648740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436211+0000","last_change":"2023-08-10T10:29:03.440207+0000","last_active":"2023-08-10T10:29:04.436211+0000","last_peered":"2023-08-10T10:29:04.436211+0000","last_clean":"2023-08-10T10:29:04.436211+0000","last_became_active":"2023-08-10T10:29:03.439702+0000","last_became_peered":"2023-08-10T10:29:03.439702+0000","last_unstale":"2023-08-10T10:29:04.436211+0000","last_undegraded":"2023-08-10T10:29:04.436211+0000","last_fullsized":"2023-08-10T10:29:04.436211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:56.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.344916+0000","last_change":"2023-08-10T10:29:02.507533+0000","last_active":"2023-08-10T10:29:06.344916+0000","last_peered":"2023-08-10T10:29:06.344916+0000","last_clean":"2023-08-10T10:29:06.344916+0000","last_became_active":"2023-08-10T10:29:02.507215+0000","last_became_peered":"2023-08-10T10:29:02.507215+0000","last_unstale":"2023-08-10T10:29:06.344916+0000","last_undegraded":"2023-08-10T10:29:06.344916+0000","last_fullsized":"2023-08-10T10:29:06.344916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:49.448663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.436223+0000","last_change":"2023-08-10T10:29:03.440169+0000","last_active":"2023-08-10T10:29:04.436223+0000","last_peered":"2023-08-10T10:29:04.436223+0000","last_clean":"2023-08-10T10:29:04.436223+0000","last_became_active":"2023-08-10T10:29:03.439746+0000","last_became_peered":"2023-08-10T10:29:03.439746+0000","last_unstale":"2023-08-10T10:29:04.436223+0000","last_undegraded":"2023-08-10T10:29:04.436223+0000","last_fullsized":"2023-08-10T10:29:04.436223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:01.039379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086444+0000","last_change":"2023-08-10T10:29:02.508038+0000","last_active":"2023-08-10T10:29:06.086444+0000","last_peered":"2023-08-10T10:29:06.086444+0000","last_clean":"2023-08-10T10:29:06.086444+0000","last_became_active":"2023-08-10T10:29:02.507705+0000","last_became_peered":"2023-08-10T10:29:02.507705+0000","last_unstale":"2023-08-10T10:29:06.086444+0000","last_undegraded":"2023-08-10T10:29:06.086444+0000","last_fullsized":"2023-08-10T10:29:06.086444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:00.037688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086412+0000","last_change":"2023-08-10T10:29:03.439576+0000","last_active":"2023-08-10T10:29:06.086412+0000","last_peered":"2023-08-10T10:29:06.086412+0000","last_clean":"2023-08-10T10:29:06.086412+0000","last_became_active":"2023-08-10T10:29:03.439303+0000","last_became_peered":"2023-08-10T10:29:03.439303+0000","last_unstale":"2023-08-10T10:29:06.086412+0000","last_undegraded":"2023-08-10T10:29:06.086412+0000","last_fullsized":"2023-08-10T10:29:06.086412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:19.095107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.796395+0000","last_change":"2023-08-10T10:29:02.514204+0000","last_active":"2023-08-10T10:29:04.796395+0000","last_peered":"2023-08-10T10:29:04.796395+0000","last_clean":"2023-08-10T10:29:04.796395+0000","last_became_active":"2023-08-10T10:29:02.514038+0000","last_became_peered":"2023-08-10T10:29:02.514038+0000","last_unstale":"2023-08-10T10:29:04.796395+0000","last_undegraded":"2023-08-10T10:29:04.796395+0000","last_fullsized":"2023-08-10T10:29:04.796395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:01.477025+0000","last_clean_scrub_stamp":"2023-08-10T10:29:01.477025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:35:24.957987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435320+0000","last_change":"2023-08-10T10:29:03.440843+0000","last_active":"2023-08-10T10:29:04.435320+0000","last_peered":"2023-08-10T10:29:04.435320+0000","last_clean":"2023-08-10T10:29:04.435320+0000","last_became_active":"2023-08-10T10:29:03.440587+0000","last_became_peered":"2023-08-10T10:29:03.440587+0000","last_unstale":"2023-08-10T10:29:04.435320+0000","last_undegraded":"2023-08-10T10:29:04.435320+0000","last_fullsized":"2023-08-10T10:29:04.435320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:12.557081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.564382+0000","last_change":"2023-08-10T10:29:03.448796+0000","last_active":"2023-08-10T10:29:06.564382+0000","last_peered":"2023-08-10T10:29:06.564382+0000","last_clean":"2023-08-10T10:29:06.564382+0000","last_became_active":"2023-08-10T10:29:03.448489+0000","last_became_peered":"2023-08-10T10:29:03.448489+0000","last_unstale":"2023-08-10T10:29:06.564382+0000","last_undegraded":"2023-08-10T10:29:06.564382+0000","last_fullsized":"2023-08-10T10:29:06.564382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:54:59.930177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086033+0000","last_change":"2023-08-10T10:29:03.441287+0000","last_active":"2023-08-10T10:29:06.086033+0000","last_peered":"2023-08-10T10:29:06.086033+0000","last_clean":"2023-08-10T10:29:06.086033+0000","last_became_active":"2023-08-10T10:29:03.441023+0000","last_became_peered":"2023-08-10T10:29:03.441023+0000","last_unstale":"2023-08-10T10:29:06.086033+0000","last_undegraded":"2023-08-10T10:29:06.086033+0000","last_fullsized":"2023-08-10T10:29:06.086033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:48.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:04.435948+0000","last_change":"2023-08-10T10:29:03.442345+0000","last_active":"2023-08-10T10:29:04.435948+0000","last_peered":"2023-08-10T10:29:04.435948+0000","last_clean":"2023-08-10T10:29:04.435948+0000","last_became_active":"2023-08-10T10:29:03.441657+0000","last_became_peered":"2023-08-10T10:29:03.441657+0000","last_unstale":"2023-08-10T10:29:04.435948+0000","last_undegraded":"2023-08-10T10:29:04.435948+0000","last_fullsized":"2023-08-10T10:29:04.435948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.086339+0000","last_change":"2023-08-10T10:29:03.447084+0000","last_active":"2023-08-10T10:29:06.086339+0000","last_peered":"2023-08-10T10:29:06.086339+0000","last_clean":"2023-08-10T10:29:06.086339+0000","last_became_active":"2023-08-10T10:29:03.446803+0000","last_became_peered":"2023-08-10T10:29:03.446803+0000","last_unstale":"2023-08-10T10:29:06.086339+0000","last_undegraded":"2023-08-10T10:29:06.086339+0000","last_fullsized":"2023-08-10T10:29:06.086339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:55.650431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-10T10:29:06.454356+0000","last_change":"2023-08-10T10:29:03.449287+0000","last_active":"2023-08-10T10:29:06.454356+0000","last_peered":"2023-08-10T10:29:06.454356+0000","last_clean":"2023-08-10T10:29:06.454356+0000","last_became_active":"2023-08-10T10:29:03.448995+0000","last_became_peered":"2023-08-10T10:29:03.448995+0000","last_unstale":"2023-08-10T10:29:06.454356+0000","last_undegraded":"2023-08-10T10:29:06.454356+0000","last_fullsized":"2023-08-10T10:29:06.454356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:29:02.478716+0000","last_clean_scrub_stamp":"2023-08-10T10:29:02.478716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:44.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:29:15.509 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-10T10:29:15.509 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-10T10:29:15.510 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-10T10:29:15.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-10T10:29:15.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.661+0000 7f1e01990700 1 Processor -- start 2023-08-10T10:29:15.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.661+0000 7f1e01990700 1 -- start start 2023-08-10T10:29:15.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1dfc15eef0 0x7f1dfc165140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc0d0950 0x7f1dfc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0b3660 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0b29e0 con 0x7f1dfc15eef0 2023-08-10T10:29:15.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1e01990700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0b2cc0 con 0x7f1dfc0d0950 2023-08-10T10:29:15.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60262/0 (socket says 172.21.15.161:60262) 2023-08-10T10:29:15.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/2010978035 learned_addr learned my addr 172.21.15.161:0/2010978035 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:15.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfb7fe700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc0d0950 0x7f1dfc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfaffd700 1 --2- 172.21.15.161:0/2010978035 >> v2:172.21.15.175:3300/0 conn(0x7f1dfc15eef0 0x7f1dfc165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/2010978035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc0d0950 msgr2=0x7f1dfc0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:15.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc0d0950 0x7f1dfc0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/2010978035 >> v2:172.21.15.175:3300/0 conn(0x7f1dfc15eef0 msgr2=0x7f1dfc165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:15.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/2010978035 >> v2:172.21.15.175:3300/0 conn(0x7f1dfc15eef0 0x7f1dfc165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/2010978035 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0b2fa0 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df00098f0 tx=0x7f1df0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f5a49dee423b06 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1df9ffb700 1 -- 172.21.15.161:0/2010978035 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0011830 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1df9ffb700 1 -- 172.21.15.161:0/2010978035 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0011990 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.662+0000 7f1df9ffb700 1 -- 172.21.15.161:0/2010978035 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0011d20 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 -- 172.21.15.161:0/2010978035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15f2d0 msgr2=0x7f1dfc0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df00098f0 tx=0x7f1df0009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:15.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 -- 172.21.15.161:0/2010978035 shutdown_connections 2023-08-10T10:29:15.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc0d0950 0x7f1dfc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 --2- 172.21.15.161:0/2010978035 >> v2:172.21.15.175:3300/0 conn(0x7f1dfc15eef0 0x7f1dfc165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 --2- 172.21.15.161:0/2010978035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15f2d0 0x7f1dfc0d0410 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 -- 172.21.15.161:0/2010978035 >> 172.21.15.161:0/2010978035 conn(0x7f1dfc06dd50 msgr2=0x7f1dfc06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:15.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 -- 172.21.15.161:0/2010978035 shutdown_connections 2023-08-10T10:29:15.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.663+0000 7f1e01990700 1 -- 172.21.15.161:0/2010978035 wait complete. 2023-08-10T10:29:15.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.665+0000 7f1e01990700 1 Processor -- start 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.665+0000 7f1e01990700 1 -- start start 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc0d0950 0x7f1dfc154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc15f2d0 0x7f1dfc153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1ece40 con 0x7f1dfc15eef0 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1ed120 con 0x7f1dfc0d0950 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1e01990700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1ed400 con 0x7f1dfc15f2d0 2023-08-10T10:29:15.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60268/0 (socket says 172.21.15.161:60268) 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/3713493093 learned_addr learned my addr 172.21.15.161:0/3713493093 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfaffd700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc0d0950 0x7f1dfc154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfb7fe700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc15f2d0 0x7f1dfc153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc15f2d0 msgr2=0x7f1dfc153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc15f2d0 0x7f1dfc153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc0d0950 msgr2=0x7f1dfc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc0d0950 0x7f1dfc154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 -- 172.21.15.161:0/3713493093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0009550 con 0x7f1dfc15eef0 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1dfa7fc700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1df0014040 tx=0x7f1df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.666+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0004450 con 0x7f1dfc15eef0 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.667+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df001f070 con 0x7f1dfc15eef0 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.667+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc1ed6e0 con 0x7f1dfc15eef0 2023-08-10T10:29:15.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.667+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00038e0 con 0x7f1dfc15eef0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.667+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc1546a0 con 0x7f1dfc15eef0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.668+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc06acc0 con 0x7f1dfc15eef0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.668+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1df0003a40 con 0x7f1dfc15eef0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.668+0000 7f1de3fff700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 0x7f1de806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.668+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1df0021070 con 0x7f1dfc15eef0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.668+0000 7f1dfaffd700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 0x7f1de806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:15.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.669+0000 7f1dfaffd700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 0x7f1de806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009be0 tx=0x7f1dec009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:15.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.673+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1df0055b40 con 0x7f1dfc15eef0 2023-08-10T10:29:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.901+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1dfc0b4540 con 0x7f1dfc15eef0 2023-08-10T10:29:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.901+0000 7f1de3fff700 1 -- 172.21.15.161:0/3713493093 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1df0015040 con 0x7f1dfc15eef0 2023-08-10T10:29:15.902 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:15.903 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-10T10:29:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 msgr2=0x7f1de806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 0x7f1de806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009be0 tx=0x7f1dec009210 comp rx=0 tx=0).stop 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 msgr2=0x7f1dfc152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1df0014040 tx=0x7f1df0004750 comp rx=0 tx=0).stop 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 shutdown_connections 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1de806ace0 0x7f1de806d1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dfc15f2d0 0x7f1dfc153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc0d0950 0x7f1dfc154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 --2- 172.21.15.161:0/3713493093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dfc15eef0 0x7f1dfc152ee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:15.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 >> 172.21.15.161:0/3713493093 conn(0x7f1dfc06dd50 msgr2=0x7f1dfc15fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:15.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 shutdown_connections 2023-08-10T10:29:15.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:15.903+0000 7f1e01990700 1 -- 172.21.15.161:0/3713493093 wait complete. 2023-08-10T10:29:15.917 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-10T10:29:15.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:16.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.037+0000 7fd3070bb700 1 Processor -- start 2023-08-10T10:29:16.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.037+0000 7fd3070bb700 1 -- start start 2023-08-10T10:29:16.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd3070bb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3000aea70 0x7fd3000c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd3070bb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd300071940 0x7fd30006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd3070bb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3000cf6a0 con 0x7fd30006a190 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd3070bb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30006eb80 con 0x7fd300071940 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd3070bb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3000af510 con 0x7fd3000aea70 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd300071940 0x7fd30006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd300071940 0x7fd30006a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60278/0 (socket says 172.21.15.161:60278) 2023-08-10T10:29:16.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd304e57700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd30006a190 0x7fd30006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37280/0 (socket says 172.21.15.161:37280) 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 -- 172.21.15.161:0/1181916789 learned_addr learned my addr 172.21.15.161:0/1181916789 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd2fffff700 1 --2- 172.21.15.161:0/1181916789 >> v2:172.21.15.175:3300/0 conn(0x7fd3000aea70 0x7fd3000c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 -- 172.21.15.161:0/1181916789 >> v2:172.21.15.175:3300/0 conn(0x7fd3000aea70 msgr2=0x7fd3000c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 --2- 172.21.15.161:0/1181916789 >> v2:172.21.15.175:3300/0 conn(0x7fd3000aea70 0x7fd3000c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 -- 172.21.15.161:0/1181916789 >> v1:172.21.15.161:6789/0 conn(0x7fd30006a190 legacy=0x7fd30006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 -- 172.21.15.161:0/1181916789 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30006ae60 con 0x7fd300071940 2023-08-10T10:29:16.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd2ff7fe700 1 -- 172.21.15.161:0/1181916789 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294980620 0 0) 0x7fd3000cf6a0 con 0x7fd30006a190 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd305658700 1 --2- 172.21.15.161:0/1181916789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30006a570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd30006e280 tx=0x7fd2f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b1bccf01013c17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd2ff7fe700 1 -- 172.21.15.161:0/1181916789 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800e070 con 0x7fd300071940 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd2ff7fe700 1 -- 172.21.15.161:0/1181916789 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f800b9c0 con 0x7fd300071940 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.038+0000 7fd2ff7fe700 1 -- 172.21.15.161:0/1181916789 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800bd70 con 0x7fd300071940 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 -- 172.21.15.161:0/1181916789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 msgr2=0x7fd30006a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 --2- 172.21.15.161:0/1181916789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30006a570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd30006e280 tx=0x7fd2f800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:16.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 -- 172.21.15.161:0/1181916789 shutdown_connections 2023-08-10T10:29:16.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 --2- 172.21.15.161:0/1181916789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30006a570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 --2- 172.21.15.161:0/1181916789 >> v2:172.21.15.175:3300/0 conn(0x7fd3000aea70 0x7fd3000c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 -- 172.21.15.161:0/1181916789 >> 172.21.15.161:0/1181916789 conn(0x7fd3000cfd70 msgr2=0x7fd3000d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 -- 172.21.15.161:0/1181916789 shutdown_connections 2023-08-10T10:29:16.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.039+0000 7fd3070bb700 1 -- 172.21.15.161:0/1181916789 wait complete. 2023-08-10T10:29:16.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.040+0000 7fd3070bb700 1 Processor -- start 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.041+0000 7fd3070bb700 1 -- start start 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 0x7fd3001f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000aea70 0x7fd3000b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015f030 con 0x7fd300071940 2023-08-10T10:29:16.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015e420 con 0x7fd3000aea70 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015e700 con 0x7fd30006a190 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60282/0 (socket says 172.21.15.161:60282) 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 -- 172.21.15.161:0/671220148 learned_addr learned my addr 172.21.15.161:0/671220148 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd304e57700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 0x7fd3001f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd305658700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000aea70 0x7fd3000b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 -- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 msgr2=0x7fd3001f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 0x7fd3001f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 -- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000aea70 msgr2=0x7fd3000b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000aea70 0x7fd3000b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 -- 172.21.15.161:0/671220148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8009b30 con 0x7fd300071940 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd304e57700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 0x7fd3001f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:16.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fffff700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e810 tx=0x7fd2ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec013610 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec013790 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30015e9e0 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec013b40 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.042+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30015e0b0 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.043+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3000744e0 con 0x7fd300071940 2023-08-10T10:29:16.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.044+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2ec013ca0 con 0x7fd300071940 2023-08-10T10:29:16.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.044+0000 7fd2fd7fa700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 0x7fd2e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.044+0000 7fd304e57700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 0x7fd2e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.044+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2ec089080 con 0x7fd300071940 2023-08-10T10:29:16.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.045+0000 7fd304e57700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 0x7fd2e406d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.049+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd2ec057c50 con 0x7fd300071940 2023-08-10T10:29:16.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.238+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3000cc2b0 con 0x7fd300071940 2023-08-10T10:29:16.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.239+0000 7fd2fd7fa700 1 -- 172.21.15.161:0/671220148 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd2ec0577e0 con 0x7fd300071940 2023-08-10T10:29:16.241 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:16.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 msgr2=0x7fd2e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 0x7fd2e406d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f4007d30 comp rx=0 tx=0).stop 2023-08-10T10:29:16.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 msgr2=0x7fd30015f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e810 tx=0x7fd2ec00eb20 comp rx=0 tx=0).stop 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 shutdown_connections 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd2e406ace0 0x7fd2e406d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000aea70 0x7fd3000b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd30006a190 0x7fd3001f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 --2- 172.21.15.161:0/671220148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd300071940 0x7fd30015f6a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 >> 172.21.15.161:0/671220148 conn(0x7fd3000cfd70 msgr2=0x7fd30006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 shutdown_connections 2023-08-10T10:29:16.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.242+0000 7fd3070bb700 1 -- 172.21.15.161:0/671220148 wait complete. 2023-08-10T10:29:16.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:16.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:16.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 Processor -- start 2023-08-10T10:29:16.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 -- start start 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3dd4159fd0 0x7f3dd415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 0x7f3dd40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40b20b0 con 0x7f3dd415a3b0 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd415abb0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.379+0000 7f3dda219700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd415ae90 con 0x7f3dd40b1740 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3dd4159fd0 0x7f3dd415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd2ffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3dd415a3b0 0x7f3dd40cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37294/0 (socket says 172.21.15.161:37294) 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3dd4159fd0 0x7f3dd415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60288/0 (socket says 172.21.15.161:60288) 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd2ffd700 1 -- 172.21.15.161:0/2743078125 learned_addr learned my addr 172.21.15.161:0/2743078125 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd3fff700 1 --2- 172.21.15.161:0/2743078125 >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 0x7f3dd40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 -- 172.21.15.161:0/2743078125 >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 msgr2=0x7f3dd40b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/2743078125 >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 0x7f3dd40b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 -- 172.21.15.161:0/2743078125 >> v1:172.21.15.161:6789/0 conn(0x7f3dd415a3b0 legacy=0x7f3dd40cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd27fc700 1 -- 172.21.15.161:0/2743078125 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679686718 0 0) 0x7f3dd40b20b0 con 0x7f3dd415a3b0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 -- 172.21.15.161:0/2743078125 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd415b170 con 0x7f3dd4159fd0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd3fff700 1 --2- 172.21.15.161:0/2743078125 >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 0x7f3dd40b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/2743078125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd415e4f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dd415d890 tx=0x7f3dc4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e22775b5933380 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd27fc700 1 -- 172.21.15.161:0/2743078125 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4011830 con 0x7f3dd4159fd0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd27fc700 1 -- 172.21.15.161:0/2743078125 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc4011990 con 0x7f3dd4159fd0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.380+0000 7f3dd27fc700 1 -- 172.21.15.161:0/2743078125 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4011d20 con 0x7f3dd4159fd0 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 -- 172.21.15.161:0/2743078125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 msgr2=0x7f3dd415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 --2- 172.21.15.161:0/2743078125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd415e4f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dd415d890 tx=0x7f3dc4009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:16.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 -- 172.21.15.161:0/2743078125 shutdown_connections 2023-08-10T10:29:16.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 --2- 172.21.15.161:0/2743078125 >> v2:172.21.15.175:3300/0 conn(0x7f3dd40b1740 0x7f3dd40b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 --2- 172.21.15.161:0/2743078125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd415e4f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 -- 172.21.15.161:0/2743078125 >> 172.21.15.161:0/2743078125 conn(0x7f3dd40cc740 msgr2=0x7f3dd40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 -- 172.21.15.161:0/2743078125 shutdown_connections 2023-08-10T10:29:16.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.381+0000 7f3dda219700 1 -- 172.21.15.161:0/2743078125 wait complete. 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.382+0000 7f3dda219700 1 Processor -- start 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.382+0000 7f3dda219700 1 -- start start 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 0x7f3dd414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dd415a3b0 0x7f3dd40c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40c8820 con 0x7f3dd4159fd0 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40b2d90 con 0x7f3dd40b1740 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dda219700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40c8540 con 0x7f3dd415a3b0 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60296/0 (socket says 172.21.15.161:60296) 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 -- 172.21.15.161:0/1864656025 learned_addr learned my addr 172.21.15.161:0/1864656025 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 0x7f3dd414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd3fff700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dd415a3b0 0x7f3dd40c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 -- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dd415a3b0 msgr2=0x7f3dd40c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dd415a3b0 0x7f3dd40c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 -- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 msgr2=0x7f3dd414bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 0x7f3dd414bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 -- 172.21.15.161:0/1864656025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40094a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 0x7f3dd414bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.383+0000 7f3dd2ffd700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c550 tx=0x7f3dc800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004c80 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8004e00 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd40b2740 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007310 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd414c2a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.384+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd40b25a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.385+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3dc8007470 con 0x7f3dd4159fd0 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.385+0000 7f3dbbfff700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 0x7f3dc006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.385+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dc80891c0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.385+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 0x7f3dc006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.386+0000 7f3dd37fe700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 0x7f3dc006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40090b0 tx=0x7f3dc4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.390+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3dd40b25a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.574+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3dd40b25a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.575+0000 7f3dbbfff700 1 -- 172.21.15.161:0/1864656025 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dd40b25a0 con 0x7f3dd4159fd0 2023-08-10T10:29:16.577 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:16.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 msgr2=0x7f3dc006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 0x7f3dc006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40090b0 tx=0x7f3dc4008030 comp rx=0 tx=0).stop 2023-08-10T10:29:16.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 msgr2=0x7f3dd40c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c550 tx=0x7f3dc800c910 comp rx=0 tx=0).stop 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 shutdown_connections 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3dc006ace0 0x7f3dc006d1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dd415a3b0 0x7f3dd40c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd40b1740 0x7f3dd414bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 --2- 172.21.15.161:0/1864656025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd4159fd0 0x7f3dd40c90c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 >> 172.21.15.161:0/1864656025 conn(0x7f3dd40cc740 msgr2=0x7f3dd406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 shutdown_connections 2023-08-10T10:29:16.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.577+0000 7f3dda219700 1 -- 172.21.15.161:0/1864656025 wait complete. 2023-08-10T10:29:16.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:16.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.714+0000 7f3bdc73e700 1 Processor -- start 2023-08-10T10:29:16.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.714+0000 7f3bdc73e700 1 -- start start 2023-08-10T10:29:16.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdc73e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 0x7f3bd40cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdc73e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 0x7f3bd40cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdc73e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40c9cb0 con 0x7f3bd415a550 2023-08-10T10:29:16.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdc73e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40711e0 con 0x7f3bd415a170 2023-08-10T10:29:16.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdc73e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4070ed0 con 0x7f3bd40cffe0 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bd9cd9700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3bd415a550 0x7f3bd40ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37308/0 (socket says 172.21.15.161:37308) 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bd9cd9700 1 -- 172.21.15.161:0/970834630 learned_addr learned my addr 172.21.15.161:0/970834630 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/970834630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 0x7f3bd40cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bda4da700 1 --2- 172.21.15.161:0/970834630 >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 0x7f3bd40cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bd94d8700 1 -- 172.21.15.161:0/970834630 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956999330 0 0) 0x7f3bd40c9cb0 con 0x7f3bd415a550 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bd94d8700 1 -- 172.21.15.161:0/970834630 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc00035b0 con 0x7f3bd415a550 2023-08-10T10:29:16.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdacdb700 1 -- 172.21.15.161:0/970834630 >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 msgr2=0x7f3bd40cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/970834630 >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 0x7f3bd40cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.715+0000 7f3bdacdb700 1 -- 172.21.15.161:0/970834630 >> v1:172.21.15.161:6789/0 conn(0x7f3bd415a550 legacy=0x7f3bd40ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdacdb700 1 -- 172.21.15.161:0/970834630 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40c9f90 con 0x7f3bd40cffe0 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bda4da700 1 --2- 172.21.15.161:0/970834630 >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 0x7f3bd40cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/970834630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 0x7f3bd40cac60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009840 tx=0x7f3bd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebc300ceefd4e68 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bd94d8700 1 -- 172.21.15.161:0/970834630 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0011830 con 0x7f3bd40cffe0 2023-08-10T10:29:16.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bd94d8700 1 -- 172.21.15.161:0/970834630 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0011990 con 0x7f3bd40cffe0 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bd94d8700 1 -- 172.21.15.161:0/970834630 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0011d20 con 0x7f3bd40cffe0 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 -- 172.21.15.161:0/970834630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 msgr2=0x7f3bd40cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/970834630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 0x7f3bd40cac60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009840 tx=0x7f3bd0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 -- 172.21.15.161:0/970834630 shutdown_connections 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/970834630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd40cffe0 0x7f3bd40cac60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/970834630 >> v2:172.21.15.175:3300/0 conn(0x7f3bd415a170 0x7f3bd40cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.716+0000 7f3bdc73e700 1 -- 172.21.15.161:0/970834630 >> 172.21.15.161:0/970834630 conn(0x7f3bd40cf4c0 msgr2=0x7f3bd40cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.717+0000 7f3bdc73e700 1 -- 172.21.15.161:0/970834630 shutdown_connections 2023-08-10T10:29:16.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.717+0000 7f3bdc73e700 1 -- 172.21.15.161:0/970834630 wait complete. 2023-08-10T10:29:16.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.718+0000 7f3bdc73e700 1 Processor -- start 2023-08-10T10:29:16.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.718+0000 7f3bdc73e700 1 -- start start 2023-08-10T10:29:16.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd40cffe0 0x7f3bd414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd415a170 0x7f3bd406a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4150030 con 0x7f3bd415a550 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40b2da0 con 0x7f3bd40cffe0 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdc73e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40ad9d0 con 0x7f3bd415a170 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60310/0 (socket says 172.21.15.161:60310) 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 -- 172.21.15.161:0/139943006 learned_addr learned my addr 172.21.15.161:0/139943006 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:16.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bda4da700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd40cffe0 0x7f3bd414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bd9cd9700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd415a170 0x7f3bd406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 -- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd415a170 msgr2=0x7f3bd406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd415a170 0x7f3bd406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 -- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd40cffe0 msgr2=0x7f3bd414faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd40cffe0 0x7f3bd414faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.719+0000 7f3bdacdb700 1 -- 172.21.15.161:0/139943006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009a70 con 0x7f3bd415a550 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bdacdb700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0004450 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd001f070 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00094a0 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00038e0 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.720+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd40adf90 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.721+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd404ecc0 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.721+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bd0003a40 con 0x7f3bd415a550 2023-08-10T10:29:16.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.722+0000 7f3bcaffd700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 0x7f3bb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:16.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.722+0000 7f3bda4da700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 0x7f3bb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:16.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.722+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bd0021070 con 0x7f3bd415a550 2023-08-10T10:29:16.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.722+0000 7f3bda4da700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 0x7f3bb806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009fd0 tx=0x7f3bcc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:16.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.726+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3bd0055bf0 con 0x7f3bd415a550 2023-08-10T10:29:16.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.909+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bd40b5440 con 0x7f3bd415a550 2023-08-10T10:29:16.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.909+0000 7f3bcaffd700 1 -- 172.21.15.161:0/139943006 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bd0015020 con 0x7f3bd415a550 2023-08-10T10:29:16.911 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 msgr2=0x7f3bb806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 0x7f3bb806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009fd0 tx=0x7f3bcc00b040 comp rx=0 tx=0).stop 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 msgr2=0x7f3bd406a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd0004750 comp rx=0 tx=0).stop 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 shutdown_connections 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3bb806ace0 0x7f3bb806d1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bd415a550 0x7f3bd406a6d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd40cffe0 0x7f3bd414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 --2- 172.21.15.161:0/139943006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd415a170 0x7f3bd406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:16.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 >> 172.21.15.161:0/139943006 conn(0x7f3bd40cf4c0 msgr2=0x7f3bd40ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:16.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 shutdown_connections 2023-08-10T10:29:16.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:16.911+0000 7f3bdc73e700 1 -- 172.21.15.161:0/139943006 wait complete. 2023-08-10T10:29:16.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:17.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 Processor -- start 2023-08-10T10:29:17.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 -- start start 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94d806cf60 0x7f94d80701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80d0610 con 0x7f94d815cfc0 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80d08f0 con 0x7f94d80cd3e0 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.047+0000 7f94dd3c9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80d0bd0 con 0x7f94d806cf60 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f94d815cfc0 0x7f94d80b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37320/0 (socket says 172.21.15.161:37320) 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 -- 172.21.15.161:0/2958438946 learned_addr learned my addr 172.21.15.161:0/2958438946 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:17.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d67fc700 1 --2- 172.21.15.161:0/2958438946 >> v2:172.21.15.175:3300/0 conn(0x7f94d806cf60 0x7f94d80701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131344951 0 0) 0x7f94d80d0610 con 0x7f94d815cfc0 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c00035b0 con 0x7f94d815cfc0 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935561736 0 0) 0x7f94c00035b0 con 0x7f94d815cfc0 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 >> v2:172.21.15.175:3300/0 conn(0x7f94d806cf60 msgr2=0x7f94d80701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 --2- 172.21.15.161:0/2958438946 >> v2:172.21.15.175:3300/0 conn(0x7f94d806cf60 0x7f94d80701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 >> v1:172.21.15.175:6789/0 conn(0x7f94d80cd3e0 legacy=0x7f94d8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80b2940 con 0x7f94d815cfc0 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f94c8001670 con 0x7f94d815cfc0 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 >> v1:172.21.15.161:6789/0 conn(0x7f94d815cfc0 legacy=0x7f94d80b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 0x7f94c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0004850 0x7f94c0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c0005210 0x7f94c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80d0bd0 con 0x7f94c0003a00 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c000c0b0 con 0x7f94c0005210 2023-08-10T10:29:17.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c000c270 con 0x7f94c0004850 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 0x7f94c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d77fe700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c0005210 0x7f94c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d67fc700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0004850 0x7f94c0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 -- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0004850 msgr2=0x7f94c0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0004850 0x7f94c0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 -- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c0005210 msgr2=0x7f94c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.048+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c0005210 0x7f94c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d6ffd700 1 -- 172.21.15.161:0/2958438946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00035b0 con 0x7f94c0003a00 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d77fe700 1 -- 172.21.15.161:0/2958438946 reap_dead start 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 0x7f94c0003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c240 tx=0x7f94c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f909fd0219852fd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8007c10 con 0x7f94c0003a00 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800ce00 con 0x7f94c0003a00 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94d5ffb700 1 -- 172.21.15.161:0/2958438946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8005ba0 con 0x7f94c0003a00 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 -- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 msgr2=0x7f94c0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 0x7f94c0003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c240 tx=0x7f94c0005880 comp rx=0 tx=0).stop 2023-08-10T10:29:17.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 -- 172.21.15.161:0/2958438946 shutdown_connections 2023-08-10T10:29:17.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/2958438946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c0003a00 0x7f94c0003e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 -- 172.21.15.161:0/2958438946 >> 172.21.15.161:0/2958438946 conn(0x7f94d806dd50 msgr2=0x7f94d806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 -- 172.21.15.161:0/2958438946 shutdown_connections 2023-08-10T10:29:17.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.049+0000 7f94dd3c9700 1 -- 172.21.15.161:0/2958438946 wait complete. 2023-08-10T10:29:17.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 Processor -- start 2023-08-10T10:29:17.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 -- start start 2023-08-10T10:29:17.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0003a00 0x7f94d8157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 0x7f94d81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81604f0 con 0x7f94d80ca440 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c93a0 con 0x7f94d8157d40 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.051+0000 7f94dd3c9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c9680 con 0x7f94c0003a00 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60328/0 (socket says 172.21.15.161:60328) 2023-08-10T10:29:17.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 -- 172.21.15.161:0/1021029409 learned_addr learned my addr 172.21.15.161:0/1021029409 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d77fe700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 0x7f94d81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0003a00 0x7f94d8157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 -- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0003a00 msgr2=0x7f94d8157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0003a00 0x7f94d8157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 -- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 msgr2=0x7f94d81581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 0x7f94d81581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 -- 172.21.15.161:0/1021029409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80c9960 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d77fe700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 0x7f94d81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94d67fc700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94cc011aa0 tx=0x7f94cc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00f9e0 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00fb40 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc014440 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80c9c40 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.052+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d8157a60 con 0x7f94d80ca440 2023-08-10T10:29:17.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.053+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80ca160 con 0x7f94d80ca440 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.053+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94cc0145a0 con 0x7f94d80ca440 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.054+0000 7f94bf7fe700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 0x7f94c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.054+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94cc089b70 con 0x7f94d80ca440 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.054+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 0x7f94c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.054+0000 7f94d6ffd700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 0x7f94c406d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94c8015040 tx=0x7f94c8007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.058+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f94d80ca160 con 0x7f94d80ca440 2023-08-10T10:29:17.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.245+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94d80ca160 con 0x7f94d80ca440 2023-08-10T10:29:17.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.246+0000 7f94bf7fe700 1 -- 172.21.15.161:0/1021029409 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94d80ca160 con 0x7f94d80ca440 2023-08-10T10:29:17.247 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.247+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 msgr2=0x7f94c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 0x7f94c406d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94c8015040 tx=0x7f94c8007000 comp rx=0 tx=0).stop 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 msgr2=0x7f94d80ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94cc011aa0 tx=0x7f94cc011e60 comp rx=0 tx=0).stop 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 shutdown_connections 2023-08-10T10:29:17.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94c406ace0 0x7f94c406d1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8157d40 0x7f94d81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c0003a00 0x7f94d8157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 --2- 172.21.15.161:0/1021029409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d80ca440 0x7f94d80ca8c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 >> 172.21.15.161:0/1021029409 conn(0x7f94d806dd50 msgr2=0x7f94d806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 shutdown_connections 2023-08-10T10:29:17.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.248+0000 7f94dd3c9700 1 -- 172.21.15.161:0/1021029409 wait complete. 2023-08-10T10:29:17.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.386+0000 7f5c0afb0700 1 Processor -- start 2023-08-10T10:29:17.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.386+0000 7f5c0afb0700 1 -- start start 2023-08-10T10:29:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0afb0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c040cda70 0x7f5c040c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0afb0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040706a0 con 0x7f5c040ce230 2023-08-10T10:29:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0afb0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040ce680 con 0x7f5c0406d0b0 2023-08-10T10:29:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0afb0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c04070940 con 0x7f5c040cda70 2023-08-10T10:29:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0954d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5c040ce230 0x7f5c0406b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37344/0 (socket says 172.21.15.161:37344) 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.387+0000 7f5c0954d700 1 -- 172.21.15.161:0/2921239040 learned_addr learned my addr 172.21.15.161:0/2921239040 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 --2- 172.21.15.161:0/2921239040 >> v2:172.21.15.175:3300/0 conn(0x7f5c040cda70 0x7f5c040c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155266860 0 0) 0x7f5c040706a0 con 0x7f5c040ce230 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf40046c0 con 0x7f5c040ce230 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710911806 0 0) 0x7f5bf40046c0 con 0x7f5c040ce230 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 >> v2:172.21.15.175:3300/0 conn(0x7f5c040cda70 msgr2=0x7f5c040c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 --2- 172.21.15.161:0/2921239040 >> v2:172.21.15.175:3300/0 conn(0x7f5c040cda70 0x7f5c040c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 >> v1:172.21.15.175:6789/0 conn(0x7f5c0406d0b0 legacy=0x7f5c040cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04070c20 con 0x7f5c040ce230 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f5bfc0019f0 con 0x7f5c040ce230 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 >> v1:172.21.15.161:6789/0 conn(0x7f5c040ce230 legacy=0x7f5c0406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bf4004b10 0x7f5bf4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 0x7f5bf4005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4006440 0x7f5bf400cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04070940 con 0x7f5bf4005960 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf400d310 con 0x7f5bf4006440 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf400d4d0 con 0x7f5bf4004b10 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 0x7f5bf4005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c08d4c700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bf4004b10 0x7f5bf4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c0954d700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4006440 0x7f5bf400cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 -- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bf4004b10 msgr2=0x7f5bf4004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bf4004b10 0x7f5bf4004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 -- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4006440 msgr2=0x7f5bf400cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4006440 0x7f5bf400cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c0954d700 1 -- 172.21.15.161:0/2921239040 reap_dead start 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.388+0000 7f5c03fff700 1 -- 172.21.15.161:0/2921239040 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40046c0 con 0x7f5bf4005960 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c03fff700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 0x7f5bf4005de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009b30 tx=0x7f5bf4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f19e9383fd7c293 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000e6c0 con 0x7f5bf4005960 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000e820 con 0x7f5bf4005960 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c037fe700 1 -- 172.21.15.161:0/2921239040 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000eb90 con 0x7f5bf4005960 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 -- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 msgr2=0x7f5bf4005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 0x7f5bf4005de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009b30 tx=0x7f5bf4006990 comp rx=0 tx=0).stop 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 -- 172.21.15.161:0/2921239040 shutdown_connections 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/2921239040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4005960 0x7f5bf4005de0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 -- 172.21.15.161:0/2921239040 >> 172.21.15.161:0/2921239040 conn(0x7f5c0406a190 msgr2=0x7f5c0406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 -- 172.21.15.161:0/2921239040 shutdown_connections 2023-08-10T10:29:17.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.389+0000 7f5c0afb0700 1 -- 172.21.15.161:0/2921239040 wait complete. 2023-08-10T10:29:17.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.391+0000 7f5c0afb0700 1 Processor -- start 2023-08-10T10:29:17.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.391+0000 7f5c0afb0700 1 -- start start 2023-08-10T10:29:17.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.391+0000 7f5c0afb0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 0x7f5c040ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.391+0000 7f5c0afb0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.391+0000 7f5c0afb0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c041f7310 0x7f5c040aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0afb0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04153c50 con 0x7f5c04152760 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0afb0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04154070 con 0x7f5bf4005960 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0afb0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04152fd0 con 0x7f5c041f7310 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60346/0 (socket says 172.21.15.161:60346) 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 -- 172.21.15.161:0/1109602472 learned_addr learned my addr 172.21.15.161:0/1109602472 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:17.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0954d700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c041f7310 0x7f5c040aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c08d4c700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 0x7f5c040ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 -- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c041f7310 msgr2=0x7f5c040aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c041f7310 0x7f5c040aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 -- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 msgr2=0x7f5c040ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 0x7f5c040ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 -- 172.21.15.161:0/1109602472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c041532b0 con 0x7f5c04152760 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c08d4c700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 0x7f5c040ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:17.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c03fff700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400d2e0 tx=0x7f5bf00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000e6c0 con 0x7f5c04152760 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0003af0 con 0x7f5c04152760 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c04153590 con 0x7f5c04152760 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0003ea0 con 0x7f5c04152760 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.392+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c04152be0 con 0x7f5c04152760 2023-08-10T10:29:17.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.393+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04066a80 con 0x7f5c04152760 2023-08-10T10:29:17.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.394+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5bf0013470 con 0x7f5c04152760 2023-08-10T10:29:17.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.394+0000 7f5c017fa700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 0x7f5be806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.394+0000 7f5c08d4c700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 0x7f5be806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.394+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bf008af80 con 0x7f5c04152760 2023-08-10T10:29:17.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.394+0000 7f5c08d4c700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 0x7f5be806d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80018d0 tx=0x7f5bf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.398+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5bf00bd330 con 0x7f5c04152760 2023-08-10T10:29:17.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.587+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c04153d90 con 0x7f5c04152760 2023-08-10T10:29:17.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.587+0000 7f5c017fa700 1 -- 172.21.15.161:0/1109602472 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c04153d90 con 0x7f5c04152760 2023-08-10T10:29:17.589 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:17.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 msgr2=0x7f5be806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 0x7f5be806d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80018d0 tx=0x7f5bf8009040 comp rx=0 tx=0).stop 2023-08-10T10:29:17.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 msgr2=0x7f5c041f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400d2e0 tx=0x7f5bf00047c0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 shutdown_connections 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5be806ace0 0x7f5be806d1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c041f7310 0x7f5c040aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bf4005960 0x7f5c040ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 --2- 172.21.15.161:0/1109602472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c04152760 0x7f5c041f6dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 >> 172.21.15.161:0/1109602472 conn(0x7f5c0406a190 msgr2=0x7f5c04158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 shutdown_connections 2023-08-10T10:29:17.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.590+0000 7f5c0afb0700 1 -- 172.21.15.161:0/1109602472 wait complete. 2023-08-10T10:29:17.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:17.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.730+0000 7ff0de0e2700 1 Processor -- start 2023-08-10T10:29:17.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.730+0000 7ff0de0e2700 1 -- start start 2023-08-10T10:29:17.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.731+0000 7ff0de0e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.731+0000 7ff0de0e2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.731+0000 7ff0de0e2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80cf6a0 con 0x7ff0d8071940 2023-08-10T10:29:17.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.731+0000 7ff0de0e2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d806eb80 con 0x7ff0d80aea70 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.731+0000 7ff0de0e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d806ac80 con 0x7ff0d806a190 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d6ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d6ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59156/0 (socket says 172.21.15.161:59156) 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45522/0 (socket says 172.21.15.161:45522) 2023-08-10T10:29:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d6ffd700 1 -- 172.21.15.161:0/4203774906 learned_addr learned my addr 172.21.15.161:0/4203774906 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d7fff700 1 --1- 172.21.15.161:0/4203774906 >> v1:172.21.15.175:6789/0 conn(0x7ff0d8071940 0x7ff0d806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39154/0 (socket says 172.21.15.161:39154) 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 -- 172.21.15.161:0/4203774906 >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 msgr2=0x7ff0d806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/4203774906 >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 -- 172.21.15.161:0/4203774906 >> v1:172.21.15.175:6789/0 conn(0x7ff0d8071940 legacy=0x7ff0d806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 -- 172.21.15.161:0/4203774906 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d806d260 con 0x7ff0d806a190 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d6ffd700 1 --2- 172.21.15.161:0/4203774906 >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:17.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/4203774906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009840 tx=0x7ff0c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a365286a027132 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d67fc700 1 -- 172.21.15.161:0/4203774906 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0011830 con 0x7ff0d806a190 2023-08-10T10:29:17.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d67fc700 1 -- 172.21.15.161:0/4203774906 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0011990 con 0x7ff0d806a190 2023-08-10T10:29:17.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.732+0000 7ff0d67fc700 1 -- 172.21.15.161:0/4203774906 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0011d20 con 0x7ff0d806a190 2023-08-10T10:29:17.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 -- 172.21.15.161:0/4203774906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 msgr2=0x7ff0d80c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/4203774906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009840 tx=0x7ff0c0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 -- 172.21.15.161:0/4203774906 shutdown_connections 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/4203774906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d80c6810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/4203774906 >> v2:172.21.15.175:3300/0 conn(0x7ff0d80aea70 0x7ff0d806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 -- 172.21.15.161:0/4203774906 >> 172.21.15.161:0/4203774906 conn(0x7ff0d80cfd70 msgr2=0x7ff0d80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 -- 172.21.15.161:0/4203774906 shutdown_connections 2023-08-10T10:29:17.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.733+0000 7ff0de0e2700 1 -- 172.21.15.161:0/4203774906 wait complete. 2023-08-10T10:29:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.734+0000 7ff0de0e2700 1 Processor -- start 2023-08-10T10:29:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.734+0000 7ff0de0e2700 1 -- start start 2023-08-10T10:29:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 0x7ff0d80ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d815f290 con 0x7ff0d80aea70 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d815aad0 con 0x7ff0d8071940 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0de0e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8159450 con 0x7ff0d806a190 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60362/0 (socket says 172.21.15.161:60362) 2023-08-10T10:29:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 -- 172.21.15.161:0/3527994986 learned_addr learned my addr 172.21.15.161:0/3527994986 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d6ffd700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 0x7ff0d80ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 -- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 msgr2=0x7ff0d815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 -- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 msgr2=0x7ff0d80ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 0x7ff0d80ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d7fff700 1 -- 172.21.15.161:0/3527994986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009550 con 0x7ff0d80aea70 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d6ffd700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 0x7ff0d80ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.735+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0d7fff700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000cba0 tx=0x7ff0d000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000aaa0 con 0x7ff0d80aea70 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000ac00 con 0x7ff0d80aea70 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0007070 con 0x7ff0d80aea70 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c00094a0 con 0x7ff0d80aea70 2023-08-10T10:29:17.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.736+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8159a10 con 0x7ff0d80aea70 2023-08-10T10:29:17.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.737+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d815f0f0 con 0x7ff0d80aea70 2023-08-10T10:29:17.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.737+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0d00071d0 con 0x7ff0d80aea70 2023-08-10T10:29:17.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.737+0000 7ff0cffff700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 0x7ff0b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:17.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.738+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d0088fe0 con 0x7ff0d80aea70 2023-08-10T10:29:17.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.738+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 0x7ff0b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:17.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.738+0000 7ff0d77fe700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 0x7ff0b806d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009fd0 tx=0x7ff0c001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:17.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.742+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0d815f0f0 con 0x7ff0d80aea70 2023-08-10T10:29:17.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.972+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d815f0f0 con 0x7ff0d80aea70 2023-08-10T10:29:17.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.972+0000 7ff0cffff700 1 -- 172.21.15.161:0/3527994986 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7ff0d815f0f0 con 0x7ff0d80aea70 2023-08-10T10:29:17.975 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:17.975 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:17.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.974+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 msgr2=0x7ff0b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.974+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 0x7ff0b806d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009fd0 tx=0x7ff0c001c040 comp rx=0 tx=0).stop 2023-08-10T10:29:17.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.974+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 msgr2=0x7ff0d8150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:17.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.974+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000cba0 tx=0x7ff0d000ceb0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 shutdown_connections 2023-08-10T10:29:17.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff0b806ace0 0x7ff0b806d1a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0d80aea70 0x7ff0d8150bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d806a190 0x7ff0d815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 --2- 172.21.15.161:0/3527994986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8071940 0x7ff0d80ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:17.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 >> 172.21.15.161:0/3527994986 conn(0x7ff0d80cfd70 msgr2=0x7ff0d80cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:17.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 shutdown_connections 2023-08-10T10:29:17.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:17.975+0000 7ff0de0e2700 1 -- 172.21.15.161:0/3527994986 wait complete. 2023-08-10T10:29:17.980 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:17.988 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:18.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.112+0000 7fc24c34b700 1 Processor -- start 2023-08-10T10:29:18.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.113+0000 7fc24c34b700 1 -- start start 2023-08-10T10:29:18.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.113+0000 7fc24c34b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc24406a190 0x7fc2440c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.113+0000 7fc24c34b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 0x7fc24406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24c34b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440cf6a0 con 0x7fc244071940 2023-08-10T10:29:18.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24c34b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24406eb80 con 0x7fc24406a190 2023-08-10T10:29:18.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24c34b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24406ac80 con 0x7fc2440aea70 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc24406a190 0x7fc2440c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a8e8700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc244071940 0x7fc24406a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37376/0 (socket says 172.21.15.161:37376) 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a8e8700 1 -- 172.21.15.161:0/4272890086 learned_addr learned my addr 172.21.15.161:0/4272890086 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc2498e6700 1 --2- 172.21.15.161:0/4272890086 >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 0x7fc24406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 -- 172.21.15.161:0/4272890086 >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 msgr2=0x7fc24406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 --2- 172.21.15.161:0/4272890086 >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 0x7fc24406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 -- 172.21.15.161:0/4272890086 >> v1:172.21.15.161:6789/0 conn(0x7fc244071940 legacy=0x7fc24406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 -- 172.21.15.161:0/4272890086 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24406d260 con 0x7fc24406a190 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc2498e6700 1 --2- 172.21.15.161:0/4272890086 >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 0x7fc24406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc24a0e7700 1 --2- 172.21.15.161:0/4272890086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24406a190 0x7fc2440c6810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc24406e280 tx=0x7fc234009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9bf78572c252f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc2490e5700 1 -- 172.21.15.161:0/4272890086 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234011830 con 0x7fc24406a190 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc2490e5700 1 -- 172.21.15.161:0/4272890086 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234011990 con 0x7fc24406a190 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.114+0000 7fc2490e5700 1 -- 172.21.15.161:0/4272890086 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234011d20 con 0x7fc24406a190 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 -- 172.21.15.161:0/4272890086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24406a190 msgr2=0x7fc2440c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 --2- 172.21.15.161:0/4272890086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24406a190 0x7fc2440c6810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc24406e280 tx=0x7fc234009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 -- 172.21.15.161:0/4272890086 shutdown_connections 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 --2- 172.21.15.161:0/4272890086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24406a190 0x7fc2440c6810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 --2- 172.21.15.161:0/4272890086 >> v2:172.21.15.175:3300/0 conn(0x7fc2440aea70 0x7fc24406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 -- 172.21.15.161:0/4272890086 >> 172.21.15.161:0/4272890086 conn(0x7fc2440cfd70 msgr2=0x7fc2440d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 -- 172.21.15.161:0/4272890086 shutdown_connections 2023-08-10T10:29:18.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.115+0000 7fc24c34b700 1 -- 172.21.15.161:0/4272890086 wait complete. 2023-08-10T10:29:18.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.116+0000 7fc24c34b700 1 Processor -- start 2023-08-10T10:29:18.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.116+0000 7fc24c34b700 1 -- start start 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc24406a190 0x7fc24415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 0x7fc244146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24415e990 con 0x7fc2440aea70 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244146db0 con 0x7fc244071940 2023-08-10T10:29:18.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24c34b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24415dd10 con 0x7fc24406a190 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60376/0 (socket says 172.21.15.161:60376) 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 -- 172.21.15.161:0/2761158137 learned_addr learned my addr 172.21.15.161:0/2761158137 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc2498e6700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 0x7fc244146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a0e7700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc24406a190 0x7fc24415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 -- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc24406a190 msgr2=0x7fc24415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc24406a190 0x7fc24415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 -- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 msgr2=0x7fc244146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 0x7fc244146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 -- 172.21.15.161:0/2761158137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340094a0 con 0x7fc2440aea70 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc2498e6700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 0x7fc244146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc24a8e8700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cbc0 tx=0x7fc23c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.117+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ab50 con 0x7fc2440aea70 2023-08-10T10:29:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.118+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c00acb0 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.118+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24415dff0 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.118+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c012600 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.118+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24415e5b0 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.118+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24415ead0 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.119+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc23c01b3b0 con 0x7fc2440aea70 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.119+0000 7fc23affd700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 0x7fc22806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.119+0000 7fc24a0e7700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 0x7fc22806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.119+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc23c089180 con 0x7fc2440aea70 2023-08-10T10:29:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.120+0000 7fc24a0e7700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 0x7fc22806d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2340090b0 tx=0x7fc234008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.124+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc24415ead0 con 0x7fc2440aea70 2023-08-10T10:29:18.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.312+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc24415ead0 con 0x7fc2440aea70 2023-08-10T10:29:18.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.313+0000 7fc23affd700 1 -- 172.21.15.161:0/2761158137 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc24415ead0 con 0x7fc2440aea70 2023-08-10T10:29:18.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:18.315 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:18.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 msgr2=0x7fc22806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 0x7fc22806d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2340090b0 tx=0x7fc234008030 comp rx=0 tx=0).stop 2023-08-10T10:29:18.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 msgr2=0x7fc24415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cbc0 tx=0x7fc23c00cf80 comp rx=0 tx=0).stop 2023-08-10T10:29:18.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 shutdown_connections 2023-08-10T10:29:18.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc22806ace0 0x7fc22806d1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2440aea70 0x7fc24415b260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc24406a190 0x7fc24415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 --2- 172.21.15.161:0/2761158137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc244071940 0x7fc244146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 >> 172.21.15.161:0/2761158137 conn(0x7fc2440cfd70 msgr2=0x7fc2440cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 shutdown_connections 2023-08-10T10:29:18.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.315+0000 7fc24c34b700 1 -- 172.21.15.161:0/2761158137 wait complete. 2023-08-10T10:29:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:18.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:18.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.453+0000 7f5413860700 1 Processor -- start 2023-08-10T10:29:18.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.453+0000 7f5413860700 1 -- start start 2023-08-10T10:29:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5413860700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f540c0d0210 0x7f540c0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5413860700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 0x7f540c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5413860700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0cead0 con 0x7f540c160910 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5413860700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0cedb0 con 0x7f540c0d0210 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5413860700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0cf090 con 0x7f540c0cfcd0 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f540c0d0210 0x7f540c0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f540c0d0210 0x7f540c0d3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60382/0 (socket says 172.21.15.161:60382) 2023-08-10T10:29:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 -- 172.21.15.161:0/760156460 learned_addr learned my addr 172.21.15.161:0/760156460 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5411dfd700 1 --2- 172.21.15.161:0/760156460 >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 0x7f540c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 -- 172.21.15.161:0/760156460 >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 msgr2=0x7f540c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 --2- 172.21.15.161:0/760156460 >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 0x7f540c0b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 -- 172.21.15.161:0/760156460 >> v1:172.21.15.175:6789/0 conn(0x7f540c160910 legacy=0x7f540c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 -- 172.21.15.161:0/760156460 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0b2c40 con 0x7f540c0d0210 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5411dfd700 1 --2- 172.21.15.161:0/760156460 >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 0x7f540c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5410dfb700 1 --2- 172.21.15.161:0/760156460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c0d0210 0x7f540c0d3ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cda20 tx=0x7f53fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daf6af81872d7e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5403fff700 1 -- 172.21.15.161:0/760156460 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00b870 con 0x7f540c0d0210 2023-08-10T10:29:18.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.454+0000 7f5403fff700 1 -- 172.21.15.161:0/760156460 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00b9d0 con 0x7f540c0d0210 2023-08-10T10:29:18.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5403fff700 1 -- 172.21.15.161:0/760156460 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00bd60 con 0x7f540c0d0210 2023-08-10T10:29:18.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 -- 172.21.15.161:0/760156460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c0d0210 msgr2=0x7f540c0d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 --2- 172.21.15.161:0/760156460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c0d0210 0x7f540c0d3ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cda20 tx=0x7f53fc009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 -- 172.21.15.161:0/760156460 shutdown_connections 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 --2- 172.21.15.161:0/760156460 >> v2:172.21.15.175:3300/0 conn(0x7f540c0cfcd0 0x7f540c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 --2- 172.21.15.161:0/760156460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c0d0210 0x7f540c0d3ba0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 -- 172.21.15.161:0/760156460 >> 172.21.15.161:0/760156460 conn(0x7f540c0d3080 msgr2=0x7f540c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 -- 172.21.15.161:0/760156460 shutdown_connections 2023-08-10T10:29:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.455+0000 7f5413860700 1 -- 172.21.15.161:0/760156460 wait complete. 2023-08-10T10:29:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.456+0000 7f5413860700 1 Processor -- start 2023-08-10T10:29:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.456+0000 7f5413860700 1 -- start start 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 0x7f540c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 0x7f540c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0ca380 con 0x7f540c160910 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15a6b0 con 0x7f540c0cfcd0 2023-08-10T10:29:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5413860700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0ccf40 con 0x7f540c0c70f0 2023-08-10T10:29:18.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5410dfb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5410dfb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60388/0 (socket says 172.21.15.161:60388) 2023-08-10T10:29:18.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5410dfb700 1 -- 172.21.15.161:0/2932872636 learned_addr learned my addr 172.21.15.161:0/2932872636 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:18.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f54115fc700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 0x7f540c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.457+0000 7f5411dfd700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 0x7f540c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 -- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 msgr2=0x7f540c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 0x7f540c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 -- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 msgr2=0x7f540c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 0x7f540c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 -- 172.21.15.161:0/2932872636 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009550 con 0x7f540c160910 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5411dfd700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 0x7f540c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f54115fc700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 0x7f540c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5410dfb700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f540c08b0f0 tx=0x7f53fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004540 con 0x7f540c160910 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0036a0 con 0x7f540c160910 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0c9060 con 0x7f540c160910 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc003a30 con 0x7f540c160910 2023-08-10T10:29:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.458+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0c9620 con 0x7f540c160910 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.459+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0ca4c0 con 0x7f540c160910 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.459+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53fc021070 con 0x7f540c160910 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.460+0000 7f5401ffb700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 0x7f53f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.460+0000 7f54115fc700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 0x7f53f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.460+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53fc08ab90 con 0x7f540c160910 2023-08-10T10:29:18.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.460+0000 7f54115fc700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 0x7f53f006d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f540c0c9d90 tx=0x7f5408009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.464+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f540c0ca4c0 con 0x7f540c160910 2023-08-10T10:29:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.655+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f540c0ca4c0 con 0x7f540c160910 2023-08-10T10:29:18.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.656+0000 7f5401ffb700 1 -- 172.21.15.161:0/2932872636 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f540c0ca4c0 con 0x7f540c160910 2023-08-10T10:29:18.657 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:18.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 msgr2=0x7f53f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 0x7f53f006d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f540c0c9d90 tx=0x7f5408009040 comp rx=0 tx=0).stop 2023-08-10T10:29:18.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 msgr2=0x7f540c0c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f540c08b0f0 tx=0x7f53fc004750 comp rx=0 tx=0).stop 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 shutdown_connections 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53f006ace0 0x7f53f006d1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f540c0c70f0 0x7f540c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f540c0cfcd0 0x7f540c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 --2- 172.21.15.161:0/2932872636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f540c160910 0x7f540c0c6bb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 >> 172.21.15.161:0/2932872636 conn(0x7f540c0d3080 msgr2=0x7f540c15f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 shutdown_connections 2023-08-10T10:29:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.658+0000 7f5413860700 1 -- 172.21.15.161:0/2932872636 wait complete. 2023-08-10T10:29:18.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:18.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.793+0000 7fca2f065700 1 Processor -- start 2023-08-10T10:29:18.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.793+0000 7fca2f065700 1 -- start start 2023-08-10T10:29:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fca280b3c30 0x7fca2806c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca2806b560 0x7fca280cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca280d0440 con 0x7fca2806b560 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca280cb5d0 con 0x7fca280b3c30 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2f065700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca280cb8b0 con 0x7fca2806bcb0 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2d602700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca2806b560 0x7fca280cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2d602700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca2806b560 0x7fca280cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60398/0 (socket says 172.21.15.161:60398) 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2d602700 1 -- 172.21.15.161:0/952640529 learned_addr learned my addr 172.21.15.161:0/952640529 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca27fff700 1 --2- 172.21.15.161:0/952640529 >> v2:172.21.15.175:3300/0 conn(0x7fca280b3c30 0x7fca2806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.794+0000 7fca2ce01700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 -- 172.21.15.161:0/952640529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 msgr2=0x7fca280d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 -- 172.21.15.161:0/952640529 >> v2:172.21.15.175:3300/0 conn(0x7fca280b3c30 msgr2=0x7fca2806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 --2- 172.21.15.161:0/952640529 >> v2:172.21.15.175:3300/0 conn(0x7fca280b3c30 0x7fca2806c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 -- 172.21.15.161:0/952640529 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280cbb90 con 0x7fca2806b560 2023-08-10T10:29:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca2d602700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca2806b560 0x7fca280cf050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca28071940 tx=0x7fca2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0ae595faa371e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca277fe700 1 -- 172.21.15.161:0/952640529 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000e070 con 0x7fca2806b560 2023-08-10T10:29:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca277fe700 1 -- 172.21.15.161:0/952640529 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000b910 con 0x7fca2806b560 2023-08-10T10:29:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.795+0000 7fca277fe700 1 -- 172.21.15.161:0/952640529 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000bcc0 con 0x7fca2806b560 2023-08-10T10:29:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 -- 172.21.15.161:0/952640529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca2806b560 msgr2=0x7fca280cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca2806b560 0x7fca280cf050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca28071940 tx=0x7fca2000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 -- 172.21.15.161:0/952640529 shutdown_connections 2023-08-10T10:29:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca2806b560 0x7fca280cf050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 --2- 172.21.15.161:0/952640529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 --2- 172.21.15.161:0/952640529 >> v2:172.21.15.175:3300/0 conn(0x7fca280b3c30 0x7fca2806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 -- 172.21.15.161:0/952640529 >> 172.21.15.161:0/952640529 conn(0x7fca2809a140 msgr2=0x7fca280d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 -- 172.21.15.161:0/952640529 shutdown_connections 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.796+0000 7fca2f065700 1 -- 172.21.15.161:0/952640529 wait complete. 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.797+0000 7fca2f065700 1 Processor -- start 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.797+0000 7fca2f065700 1 -- start start 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2806b560 0x7fca280ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca280c9e60 con 0x7fca280b3c30 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca280ca440 con 0x7fca2806b560 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2f065700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca280c92e0 con 0x7fca2806bcb0 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60404/0 (socket says 172.21.15.161:60404) 2023-08-10T10:29:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 -- 172.21.15.161:0/2732925031 learned_addr learned my addr 172.21.15.161:0/2732925031 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca27fff700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2ce01700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2806b560 0x7fca280ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 -- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 msgr2=0x7fca280c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 -- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2806b560 msgr2=0x7fca280ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2806b560 0x7fca280ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 -- 172.21.15.161:0/2732925031 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009b30 con 0x7fca280b3c30 2023-08-10T10:29:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca2d602700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca28070720 tx=0x7fca20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200099b0 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.798+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000ce80 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.799+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca280c95c0 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.799+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20004490 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.799+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca280c9b80 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.800+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2804ecc0 con 0x7fca280b3c30 2023-08-10T10:29:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.800+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca200045f0 con 0x7fca280b3c30 2023-08-10T10:29:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.800+0000 7fca257fa700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 0x7fca0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.800+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca2008a3e0 con 0x7fca280b3c30 2023-08-10T10:29:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.800+0000 7fca2ce01700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 0x7fca0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.801+0000 7fca2ce01700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 0x7fca0c06d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009b40 tx=0x7fca1c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.805+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fca200555d0 con 0x7fca280b3c30 2023-08-10T10:29:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.990+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fca2806ba90 con 0x7fca280b3c30 2023-08-10T10:29:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.991+0000 7fca257fa700 1 -- 172.21.15.161:0/2732925031 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fca20058bf0 con 0x7fca280b3c30 2023-08-10T10:29:18.992 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 msgr2=0x7fca0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 0x7fca0c06d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009b40 tx=0x7fca1c009210 comp rx=0 tx=0).stop 2023-08-10T10:29:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 msgr2=0x7fca2815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca28070720 tx=0x7fca20004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 shutdown_connections 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fca0c06ace0 0x7fca0c06d1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca280b3c30 0x7fca2815ebc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2806b560 0x7fca280ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 --2- 172.21.15.161:0/2732925031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2806bcb0 0x7fca280c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 >> 172.21.15.161:0/2732925031 conn(0x7fca2809a140 msgr2=0x7fca280cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 shutdown_connections 2023-08-10T10:29:18.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:18.993+0000 7fca2f065700 1 -- 172.21.15.161:0/2732925031 wait complete. 2023-08-10T10:29:19.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:19.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.127+0000 7f8c2d89f700 1 Processor -- start 2023-08-10T10:29:19.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c2d89f700 1 -- start start 2023-08-10T10:29:19.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c2d89f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 0x7f8c2806a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c2d89f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2806ab00 con 0x7f8c280cb9f0 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c2d89f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280b25b0 con 0x7f8c280b2120 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c2d89f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28071950 con 0x7f8c2806a190 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c26ffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8c280cb9f0 0x7f8c28160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37414/0 (socket says 172.21.15.161:37414) 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.128+0000 7f8c26ffd700 1 -- 172.21.15.161:0/226574476 learned_addr learned my addr 172.21.15.161:0/226574476 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:19.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c277fe700 1 --2- 172.21.15.161:0/226574476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 0x7f8c2806a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106460682 0 0) 0x7f8c2806ab00 con 0x7f8c280cb9f0 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c100035b0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917653649 0 0) 0x7f8c280b25b0 con 0x7f8c280b2120 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2806ab00 con 0x7f8c280b2120 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511372600 0 0) 0x7f8c100035b0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c277fe700 1 -- 172.21.15.161:0/226574476 >> v1:172.21.15.175:6789/0 conn(0x7f8c280b2120 legacy=0x7f8c280cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c277fe700 1 -- 172.21.15.161:0/226574476 >> v1:172.21.15.161:6789/0 conn(0x7f8c280cb9f0 legacy=0x7f8c28160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c277fe700 1 -- 172.21.15.161:0/226574476 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2806dc10 con 0x7f8c2806a190 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c277fe700 1 --2- 172.21.15.161:0/226574476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 0x7f8c2806a5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009dc0 tx=0x7f8c2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f09465757e2e4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000e070 con 0x7f8c2806a190 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20003a20 con 0x7f8c2806a190 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.129+0000 7f8c25ffb700 1 -- 172.21.15.161:0/226574476 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c001670 con 0x7f8c2806a190 2023-08-10T10:29:19.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 -- 172.21.15.161:0/226574476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 msgr2=0x7f8c2806a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/226574476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 0x7f8c2806a5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009dc0 tx=0x7f8c2000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 -- 172.21.15.161:0/226574476 shutdown_connections 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/226574476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c2806a190 0x7f8c2806a5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 -- 172.21.15.161:0/226574476 >> 172.21.15.161:0/226574476 conn(0x7f8c280cc740 msgr2=0x7f8c280ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 -- 172.21.15.161:0/226574476 shutdown_connections 2023-08-10T10:29:19.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.130+0000 7f8c2d89f700 1 -- 172.21.15.161:0/226574476 wait complete. 2023-08-10T10:29:19.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.131+0000 7f8c2d89f700 1 Processor -- start 2023-08-10T10:29:19.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.131+0000 7f8c2d89f700 1 -- start start 2023-08-10T10:29:19.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c2806a190 0x7f8c280c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c280b2120 0x7f8c2815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c6ec0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c71a0 con 0x7f8c2806a190 2023-08-10T10:29:19.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c2d89f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c7480 con 0x7f8c280b2120 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c26ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c2806a190 0x7f8c280c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60416/0 (socket says 172.21.15.161:60416) 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 -- 172.21.15.161:0/3018328839 learned_addr learned my addr 172.21.15.161:0/3018328839 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c267fc700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c280b2120 0x7f8c2815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 -- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c280b2120 msgr2=0x7f8c2815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c280b2120 0x7f8c2815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 -- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c2806a190 msgr2=0x7f8c280c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c2806a190 0x7f8c280c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 -- 172.21.15.161:0/3018328839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009a70 con 0x7f8c280cb9f0 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.132+0000 7f8c277fe700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c20015040 tx=0x7f8c20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.133+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c200042c0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.133+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20004440 con 0x7f8c280cb9f0 2023-08-10T10:29:19.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.133+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c200047f0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.133+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280c7760 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.133+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c280c6560 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.134+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28160b10 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.134+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c2001c460 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.134+0000 7f8c0ffff700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 0x7f8c1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.134+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c2008aab0 con 0x7f8c280cb9f0 2023-08-10T10:29:19.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.134+0000 7f8c26ffd700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 0x7f8c1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.135+0000 7f8c26ffd700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 0x7f8c1406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b17b0 tx=0x7f8c1c001d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.139+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c28160b10 con 0x7f8c280cb9f0 2023-08-10T10:29:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.326+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c28160b10 con 0x7f8c280cb9f0 2023-08-10T10:29:19.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.327+0000 7f8c0ffff700 1 -- 172.21.15.161:0/3018328839 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c28160b10 con 0x7f8c280cb9f0 2023-08-10T10:29:19.328 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 msgr2=0x7f8c1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 0x7f8c1406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c280b17b0 tx=0x7f8c1c001d80 comp rx=0 tx=0).stop 2023-08-10T10:29:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 msgr2=0x7f8c280cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c20015040 tx=0x7f8c20004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 shutdown_connections 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f8c1406ace0 0x7f8c1406d1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280cb9f0 0x7f8c280cabe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c2806a190 0x7f8c280c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 --2- 172.21.15.161:0/3018328839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c280b2120 0x7f8c2815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 >> 172.21.15.161:0/3018328839 conn(0x7f8c280cc740 msgr2=0x7f8c280d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 shutdown_connections 2023-08-10T10:29:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.329+0000 7f8c2d89f700 1 -- 172.21.15.161:0/3018328839 wait complete. 2023-08-10T10:29:19.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:19.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.466+0000 7f5ff9cb7700 1 Processor -- start 2023-08-10T10:29:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 -- start start 2023-08-10T10:29:19.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ff415e4f0 0x7f5ff40cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ff40b1740 0x7f5ff40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40b20b0 con 0x7f5ff4159fd0 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff415abb0 con 0x7f5ff40b1740 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff9cb7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff415ae90 con 0x7f5ff415e4f0 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ff40b1740 0x7f5ff40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ff40b1740 0x7f5ff40b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60424/0 (socket says 172.21.15.161:60424) 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.467+0000 7f5ff3fff700 1 -- 172.21.15.161:0/3299874230 learned_addr learned my addr 172.21.15.161:0/3299874230 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff2ffd700 1 --2- 172.21.15.161:0/3299874230 >> v2:172.21.15.175:3300/0 conn(0x7f5ff415e4f0 0x7f5ff40cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff3fff700 1 -- 172.21.15.161:0/3299874230 >> v2:172.21.15.175:3300/0 conn(0x7f5ff415e4f0 msgr2=0x7f5ff40cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff3fff700 1 --2- 172.21.15.161:0/3299874230 >> v2:172.21.15.175:3300/0 conn(0x7f5ff415e4f0 0x7f5ff40cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff3fff700 1 -- 172.21.15.161:0/3299874230 >> v1:172.21.15.175:6789/0 conn(0x7f5ff4159fd0 legacy=0x7f5ff415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff3fff700 1 -- 172.21.15.161:0/3299874230 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff415b170 con 0x7f5ff40b1740 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff3fff700 1 --2- 172.21.15.161:0/3299874230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff40b1b70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40b5bf0 tx=0x7f5fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d469f755a050136 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff27fc700 1 -- 172.21.15.161:0/3299874230 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e070 con 0x7f5ff40b1740 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff27fc700 1 -- 172.21.15.161:0/3299874230 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00b910 con 0x7f5ff40b1740 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.468+0000 7f5ff27fc700 1 -- 172.21.15.161:0/3299874230 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00bcc0 con 0x7f5ff40b1740 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/3299874230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 msgr2=0x7f5ff40b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/3299874230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff40b1b70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40b5bf0 tx=0x7f5fec00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:19.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/3299874230 shutdown_connections 2023-08-10T10:29:19.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/3299874230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff40b1b70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/3299874230 >> v2:172.21.15.175:3300/0 conn(0x7f5ff415e4f0 0x7f5ff40cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/3299874230 >> 172.21.15.161:0/3299874230 conn(0x7f5ff40cc740 msgr2=0x7f5ff40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:19.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/3299874230 shutdown_connections 2023-08-10T10:29:19.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.469+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/3299874230 wait complete. 2023-08-10T10:29:19.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.470+0000 7f5ff9cb7700 1 Processor -- start 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.470+0000 7f5ff9cb7700 1 -- start start 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ff4159fd0 0x7f5ff4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ff415e4f0 0x7f5ff414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff414b420 con 0x7f5ff40b1740 2023-08-10T10:29:19.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4167d00 con 0x7f5ff4159fd0 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff9cb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4167740 con 0x7f5ff415e4f0 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60426/0 (socket says 172.21.15.161:60426) 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 -- 172.21.15.161:0/1278479562 learned_addr learned my addr 172.21.15.161:0/1278479562 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff2ffd700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ff4159fd0 0x7f5ff4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff3fff700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ff415e4f0 0x7f5ff414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 -- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ff415e4f0 msgr2=0x7f5ff414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ff415e4f0 0x7f5ff414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 -- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ff4159fd0 msgr2=0x7f5ff4150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ff4159fd0 0x7f5ff4150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 -- 172.21.15.161:0/1278479562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009b30 con 0x7f5ff40b1740 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5ff37fe700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c4e0 tx=0x7f5fe800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80052d0 con 0x7f5ff40b1740 2023-08-10T10:29:19.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.471+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8005430 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.472+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff4167a20 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.472+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80038c0 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.472+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff414f470 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.473+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff414f690 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.473+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fe8003a20 con 0x7f5ff40b1740 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.473+0000 7f5fdbfff700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 0x7f5fe006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.473+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fe8088750 con 0x7f5ff40b1740 2023-08-10T10:29:19.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.473+0000 7f5ff2ffd700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 0x7f5fe006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.474+0000 7f5ff2ffd700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 0x7f5fe006d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ff415d800 tx=0x7f5fe4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.478+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5fe8053890 con 0x7f5ff40b1740 2023-08-10T10:29:19.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.664+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ff404ecc0 con 0x7f5ff40b1740 2023-08-10T10:29:19.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.665+0000 7f5fdbfff700 1 -- 172.21.15.161:0/1278479562 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fe8056eb0 con 0x7f5ff40b1740 2023-08-10T10:29:19.666 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:19.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 msgr2=0x7f5fe006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 0x7f5fe006d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ff415d800 tx=0x7f5fe4009210 comp rx=0 tx=0).stop 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 msgr2=0x7f5ff414aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c4e0 tx=0x7f5fe800c7f0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 shutdown_connections 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5fe006ace0 0x7f5fe006d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ff415e4f0 0x7f5ff414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff40b1740 0x7f5ff414aee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 --2- 172.21.15.161:0/1278479562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ff4159fd0 0x7f5ff4150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 >> 172.21.15.161:0/1278479562 conn(0x7f5ff40cc740 msgr2=0x7f5ff415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:19.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 shutdown_connections 2023-08-10T10:29:19.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.667+0000 7f5ff9cb7700 1 -- 172.21.15.161:0/1278479562 wait complete. 2023-08-10T10:29:19.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:19.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.799+0000 7f5267d7b700 1 Processor -- start 2023-08-10T10:29:19.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.799+0000 7f5267d7b700 1 -- start start 2023-08-10T10:29:19.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5267d7b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f52600c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5267d7b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600cf6a0 con 0x7f52600aea70 2023-08-10T10:29:19.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5267d7b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526006ae60 con 0x7f5260071940 2023-08-10T10:29:19.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5267d7b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526006eb80 con 0x7f526006a190 2023-08-10T10:29:19.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5265316700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f52600aea70 0x7f526006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37440/0 (socket says 172.21.15.161:37440) 2023-08-10T10:29:19.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5265316700 1 -- 172.21.15.161:0/1495508089 learned_addr learned my addr 172.21.15.161:0/1495508089 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:19.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195066140 0 0) 0x7f52600cf6a0 con 0x7f52600aea70 2023-08-10T10:29:19.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5265b17700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f52600c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.800+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c0035b0 con 0x7f52600aea70 2023-08-10T10:29:19.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 112561347 0 0) 0x7f524c0035b0 con 0x7f52600aea70 2023-08-10T10:29:19.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 msgr2=0x7f52600c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:19.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f52600c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 >> v1:172.21.15.175:6789/0 conn(0x7f5260071940 legacy=0x7f526006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526006e7a0 con 0x7f52600aea70 2023-08-10T10:29:19.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f525c001670 con 0x7f52600aea70 2023-08-10T10:29:19.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 >> v1:172.21.15.161:6789/0 conn(0x7f52600aea70 legacy=0x7f526006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f524c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f524c003fb0 0x7f524c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c004d90 0x7f524c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526006eb80 con 0x7f524c003fb0 2023-08-10T10:29:19.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00baf0 con 0x7f524c004d90 2023-08-10T10:29:19.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00bcb0 con 0x7f526006a190 2023-08-10T10:29:19.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f524c003fb0 0x7f524c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265b17700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f524c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5266318700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c004d90 0x7f524c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 -- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 msgr2=0x7f524c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:19.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526006a190 0x7f524c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 -- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c004d90 msgr2=0x7f524c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:19.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c004d90 0x7f524c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 -- 172.21.15.161:0/1495508089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0035b0 con 0x7f524c003fb0 2023-08-10T10:29:19.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5265316700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f524c003fb0 0x7f524c004850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c210 tx=0x7f524c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89b2ac7a3c234e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c007c10 con 0x7f524c003fb0 2023-08-10T10:29:19.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00cdb0 con 0x7f524c003fb0 2023-08-10T10:29:19.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.801+0000 7f5264b15700 1 -- 172.21.15.161:0/1495508089 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c005ba0 con 0x7f524c003fb0 2023-08-10T10:29:19.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 -- 172.21.15.161:0/1495508089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f524c003fb0 msgr2=0x7f524c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 --2- 172.21.15.161:0/1495508089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f524c003fb0 0x7f524c004850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c210 tx=0x7f524c005880 comp rx=0 tx=0).stop 2023-08-10T10:29:19.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5266318700 1 -- 172.21.15.161:0/1495508089 reap_dead start 2023-08-10T10:29:19.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 -- 172.21.15.161:0/1495508089 shutdown_connections 2023-08-10T10:29:19.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 -- 172.21.15.161:0/1495508089 >> 172.21.15.161:0/1495508089 conn(0x7f52600cfd70 msgr2=0x7f52600d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:19.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 -- 172.21.15.161:0/1495508089 shutdown_connections 2023-08-10T10:29:19.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.802+0000 7f5267d7b700 1 -- 172.21.15.161:0/1495508089 wait complete. 2023-08-10T10:29:19.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.803+0000 7f5267d7b700 1 Processor -- start 2023-08-10T10:29:19.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.803+0000 7f5267d7b700 1 -- start start 2023-08-10T10:29:19.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c003fb0 0x7f526015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526015ec30 0x7f52601f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526006ac80 con 0x7f52601f6760 2023-08-10T10:29:19.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601f6c10 con 0x7f524c003fb0 2023-08-10T10:29:19.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5267d7b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526015fce0 con 0x7f526015ec30 2023-08-10T10:29:19.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60450/0 (socket says 172.21.15.161:60450) 2023-08-10T10:29:19.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 -- 172.21.15.161:0/4033125068 learned_addr learned my addr 172.21.15.161:0/4033125068 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:19.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5265b17700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c003fb0 0x7f526015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5265316700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526015ec30 0x7f52601f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 -- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526015ec30 msgr2=0x7f52601f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526015ec30 0x7f52601f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 -- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c003fb0 msgr2=0x7f526015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:19.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c003fb0 0x7f526015e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:19.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 -- 172.21.15.161:0/4033125068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526015f0d0 con 0x7f52601f6760 2023-08-10T10:29:19.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.804+0000 7f5266318700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52600af8e0 tx=0x7f525800d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258003c10 con 0x7f52601f6760 2023-08-10T10:29:19.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258003d90 con 0x7f52601f6760 2023-08-10T10:29:19.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526015f3b0 con 0x7f52601f6760 2023-08-10T10:29:19.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800d950 con 0x7f52601f6760 2023-08-10T10:29:19.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526015f970 con 0x7f52601f6760 2023-08-10T10:29:19.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.805+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526015fb30 con 0x7f52601f6760 2023-08-10T10:29:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.806+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f525800dab0 con 0x7f52601f6760 2023-08-10T10:29:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.806+0000 7f52567fc700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 0x7f524406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.806+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5258089560 con 0x7f52601f6760 2023-08-10T10:29:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.806+0000 7f5265b17700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 0x7f524406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.807+0000 7f5265b17700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 0x7f524406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5250009c60 tx=0x7f5250009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:19.811+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f52580546a0 con 0x7f52601f6760 2023-08-10T10:29:20.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.039+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f526015fe90 con 0x7f52601f6760 2023-08-10T10:29:20.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.039+0000 7f52567fc700 1 -- 172.21.15.161:0/4033125068 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f5258057cc0 con 0x7f52601f6760 2023-08-10T10:29:20.041 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:20.041 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:20.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 msgr2=0x7f524406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 0x7f524406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5250009c60 tx=0x7f5250009210 comp rx=0 tx=0).stop 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 msgr2=0x7f52601f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52600af8e0 tx=0x7f525800d150 comp rx=0 tx=0).stop 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 shutdown_connections 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f524406ace0 0x7f524406d1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52601f6760 0x7f52601f1c40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f524c003fb0 0x7f526015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 --2- 172.21.15.161:0/4033125068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526015ec30 0x7f52601f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 >> 172.21.15.161:0/4033125068 conn(0x7f52600cfd70 msgr2=0x7f52600cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:20.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 shutdown_connections 2023-08-10T10:29:20.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.041+0000 7f5267d7b700 1 -- 172.21.15.161:0/4033125068 wait complete. 2023-08-10T10:29:20.044 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:20.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:20.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.173+0000 7f042809c700 1 Processor -- start 2023-08-10T10:29:20.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.173+0000 7f042809c700 1 -- start start 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f042809c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f042006a190 0x7f04200c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f042809c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 0x7f042006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f042809c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200cf6a0 con 0x7f0420071940 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f042809c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042006eb80 con 0x7f042006a190 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f042809c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042006ac80 con 0x7f04200aea70 2023-08-10T10:29:20.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f042006a190 0x7f04200c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f042006a190 0x7f04200c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60454/0 (socket says 172.21.15.161:60454) 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0426639700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0420071940 0x7f042006a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37464/0 (socket says 172.21.15.161:37464) 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 -- 172.21.15.161:0/2132573709 learned_addr learned my addr 172.21.15.161:0/2132573709 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425637700 1 --2- 172.21.15.161:0/2132573709 >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 0x7f042006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 -- 172.21.15.161:0/2132573709 >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 msgr2=0x7f042006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 --2- 172.21.15.161:0/2132573709 >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 0x7f042006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 -- 172.21.15.161:0/2132573709 >> v1:172.21.15.161:6789/0 conn(0x7f0420071940 legacy=0x7f042006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0424e36700 1 -- 172.21.15.161:0/2132573709 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911723014 0 0) 0x7f04200cf6a0 con 0x7f0420071940 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425e38700 1 -- 172.21.15.161:0/2132573709 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042006d260 con 0x7f042006a190 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.174+0000 7f0425637700 1 --2- 172.21.15.161:0/2132573709 >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 0x7f042006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f0425e38700 1 --2- 172.21.15.161:0/2132573709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04200c6810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f042006e280 tx=0x7f0410009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6252c0cec4ccee8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f0424e36700 1 -- 172.21.15.161:0/2132573709 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000b870 con 0x7f042006a190 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f0424e36700 1 -- 172.21.15.161:0/2132573709 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000b9d0 con 0x7f042006a190 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f0424e36700 1 -- 172.21.15.161:0/2132573709 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000bd60 con 0x7f042006a190 2023-08-10T10:29:20.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 -- 172.21.15.161:0/2132573709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 msgr2=0x7f04200c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 --2- 172.21.15.161:0/2132573709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04200c6810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f042006e280 tx=0x7f0410009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 -- 172.21.15.161:0/2132573709 shutdown_connections 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 --2- 172.21.15.161:0/2132573709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04200c6810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 --2- 172.21.15.161:0/2132573709 >> v2:172.21.15.175:3300/0 conn(0x7f04200aea70 0x7f042006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 -- 172.21.15.161:0/2132573709 >> 172.21.15.161:0/2132573709 conn(0x7f04200cfd70 msgr2=0x7f04200d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 -- 172.21.15.161:0/2132573709 shutdown_connections 2023-08-10T10:29:20.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.175+0000 7f042809c700 1 -- 172.21.15.161:0/2132573709 wait complete. 2023-08-10T10:29:20.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 Processor -- start 2023-08-10T10:29:20.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 -- start start 2023-08-10T10:29:20.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0420071940 0x7f042015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 0x7f042015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200b4170 con 0x7f042006a190 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201f5dd0 con 0x7f04200aea70 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f042809c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04201f6070 con 0x7f0420071940 2023-08-10T10:29:20.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f0425e38700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f0425e38700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60460/0 (socket says 172.21.15.161:60460) 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.177+0000 7f0425e38700 1 -- 172.21.15.161:0/2109669440 learned_addr learned my addr 172.21.15.161:0/2109669440 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425637700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0420071940 0x7f042015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0426639700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 0x7f042015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 -- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0420071940 msgr2=0x7f042015d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0420071940 0x7f042015d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 -- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 msgr2=0x7f042015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 0x7f042015c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 -- 172.21.15.161:0/2109669440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410009550 con 0x7f042006a190 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0426639700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 0x7f042015c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f0425e38700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0410009c10 tx=0x7f0410004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410004520 con 0x7f042006a190 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041001e070 con 0x7f042006a190 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04201f6350 con 0x7f042006a190 2023-08-10T10:29:20.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100038e0 con 0x7f042006a190 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.178+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042015ec90 con 0x7f042006a190 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.179+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200744e0 con 0x7f042006a190 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.179+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0410003a40 con 0x7f042006a190 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.180+0000 7f04167fc700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 0x7f040406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.180+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0410020070 con 0x7f042006a190 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.180+0000 7f0425637700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 0x7f040406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.180+0000 7f0425637700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 0x7f040406d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04200aeeb0 tx=0x7f041c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.184+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0410055a40 con 0x7f042006a190 2023-08-10T10:29:20.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.373+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f042015dca0 con 0x7f042006a190 2023-08-10T10:29:20.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.374+0000 7f04167fc700 1 -- 172.21.15.161:0/2109669440 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0410059060 con 0x7f042006a190 2023-08-10T10:29:20.376 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:20.376 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:20.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.376+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 msgr2=0x7f040406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.376+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 0x7f040406d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04200aeeb0 tx=0x7f041c008040 comp rx=0 tx=0).stop 2023-08-10T10:29:20.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.376+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 msgr2=0x7f04201f2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.376+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0410009c10 tx=0x7f0410004750 comp rx=0 tx=0).stop 2023-08-10T10:29:20.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 shutdown_connections 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f040406ace0 0x7f040406d1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04200aea70 0x7f042015c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f042006a190 0x7f04201f2270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 --2- 172.21.15.161:0/2109669440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0420071940 0x7f042015d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 >> 172.21.15.161:0/2109669440 conn(0x7f04200cfd70 msgr2=0x7f0420160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 shutdown_connections 2023-08-10T10:29:20.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.377+0000 7f042809c700 1 -- 172.21.15.161:0/2109669440 wait complete. 2023-08-10T10:29:20.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:20.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.509+0000 7f3a448f9700 1 Processor -- start 2023-08-10T10:29:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.509+0000 7f3a448f9700 1 -- start start 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a448f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a400d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a448f9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a400cd670 0x7f3a400cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a448f9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400cbd50 con 0x7f3a401609f0 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a448f9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400ce040 con 0x7f3a400cd670 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a448f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400cb440 con 0x7f3a40160610 2023-08-10T10:29:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a3ed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a400cd670 0x7f3a400cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a3ed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a400cd670 0x7f3a400cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60472/0 (socket says 172.21.15.161:60472) 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.510+0000 7f3a3ed9d700 1 -- 172.21.15.161:0/3388290064 learned_addr learned my addr 172.21.15.161:0/3388290064 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3e59c700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a400d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3ed9d700 1 -- 172.21.15.161:0/3388290064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 msgr2=0x7f3a400d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3ed9d700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a400d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3ed9d700 1 -- 172.21.15.161:0/3388290064 >> v1:172.21.15.175:6789/0 conn(0x7f3a401609f0 legacy=0x7f3a400cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3ed9d700 1 -- 172.21.15.161:0/3388290064 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400d0250 con 0x7f3a400cd670 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3ed9d700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a400cdb00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009e50 tx=0x7f3a3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6310ed924f3987 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3d59a700 1 -- 172.21.15.161:0/3388290064 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800e070 con 0x7f3a400cd670 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3d59a700 1 -- 172.21.15.161:0/3388290064 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38003a20 con 0x7f3a400cd670 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a3d59a700 1 -- 172.21.15.161:0/3388290064 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38003dd0 con 0x7f3a400cd670 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a448f9700 1 -- 172.21.15.161:0/3388290064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 msgr2=0x7f3a400cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.511+0000 7f3a448f9700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a400cdb00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009e50 tx=0x7f3a3800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 -- 172.21.15.161:0/3388290064 shutdown_connections 2023-08-10T10:29:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a400cdb00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 --2- 172.21.15.161:0/3388290064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a400d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 -- 172.21.15.161:0/3388290064 >> 172.21.15.161:0/3388290064 conn(0x7f3a4009a150 msgr2=0x7f3a400d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:20.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 -- 172.21.15.161:0/3388290064 shutdown_connections 2023-08-10T10:29:20.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.512+0000 7f3a448f9700 1 -- 172.21.15.161:0/3388290064 wait complete. 2023-08-10T10:29:20.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.513+0000 7f3a448f9700 1 Processor -- start 2023-08-10T10:29:20.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.513+0000 7f3a448f9700 1 -- start start 2023-08-10T10:29:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a4006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 0x7f3a4006f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4014b750 con 0x7f3a400cd670 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4014bb70 con 0x7f3a401609f0 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4014aad0 con 0x7f3a40160610 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60474/0 (socket says 172.21.15.161:60474) 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 -- 172.21.15.161:0/4220487893 learned_addr learned my addr 172.21.15.161:0/4220487893 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3dd9b700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a4006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3ed9d700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 0x7f3a4006f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 -- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 msgr2=0x7f3a4006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a4006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 -- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 msgr2=0x7f3a4006f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 0x7f3a4006f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 -- 172.21.15.161:0/4220487893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009b30 con 0x7f3a400cd670 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3ed9d700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 0x7f3a4006f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a3e59c700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e730 tx=0x7f3a3400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400c070 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a34013610 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4014adb0 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340139c0 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.514+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4014b370 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.515+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4014b9c0 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.516+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a34013b20 con 0x7f3a400cd670 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.517+0000 7f3a2effd700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 0x7f3a2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:20.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.517+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a340897d0 con 0x7f3a400cd670 2023-08-10T10:29:20.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.517+0000 7f3a3dd9b700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 0x7f3a2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:20.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.517+0000 7f3a3dd9b700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 0x7f3a2006d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3a400cafa0 tx=0x7f3a300090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:20.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.520+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a34058300 con 0x7f3a400cd670 2023-08-10T10:29:20.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.749+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a400b3c10 con 0x7f3a400cd670 2023-08-10T10:29:20.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.750+0000 7f3a2effd700 1 -- 172.21.15.161:0/4220487893 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f3a34057e90 con 0x7f3a400cd670 2023-08-10T10:29:20.752 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:20.752 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:20.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 msgr2=0x7f3a2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 0x7f3a2006d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3a400cafa0 tx=0x7f3a300090e0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 msgr2=0x7f3a40149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e730 tx=0x7f3a3400ea40 comp rx=0 tx=0).stop 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 shutdown_connections 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f3a2006ace0 0x7f3a2006d1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a401609f0 0x7f3a4006f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a400cd670 0x7f3a40149430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 --2- 172.21.15.161:0/4220487893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40160610 0x7f3a4006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:20.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 >> 172.21.15.161:0/4220487893 conn(0x7f3a4009a150 msgr2=0x7f3a4015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:20.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 shutdown_connections 2023-08-10T10:29:20.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:20.752+0000 7f3a448f9700 1 -- 172.21.15.161:0/4220487893 wait complete. 2023-08-10T10:29:20.755 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:21.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:29:02.890013+0000', 'modified': '2023-08-10T10:29:06.510357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6835/2919122780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6833', 'nonce': 2919122780}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2919122780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:29:21.169 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:29:21.169 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:29:21.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.297+0000 7f53d78dc700 1 Processor -- start 2023-08-10T10:29:21.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.297+0000 7f53d78dc700 1 -- start start 2023-08-10T10:29:21.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d78dc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53d00aea70 0x7f53d00c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d78dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d78dc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00cf6a0 con 0x7f53d006a190 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d78dc700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d006eb80 con 0x7f53d00aea70 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d78dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00af510 con 0x7f53d0071940 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53d00aea70 0x7f53d00c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53d00aea70 0x7f53d00c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60482/0 (socket says 172.21.15.161:60482) 2023-08-10T10:29:21.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 -- 172.21.15.161:0/2787698139 learned_addr learned my addr 172.21.15.161:0/2787698139 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d5e79700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 -- 172.21.15.161:0/2787698139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 msgr2=0x7f53d006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d006a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 -- 172.21.15.161:0/2787698139 >> v1:172.21.15.175:6789/0 conn(0x7f53d006a190 legacy=0x7f53d006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 -- 172.21.15.161:0/2787698139 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d006ae60 con 0x7f53d00aea70 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.298+0000 7f53d4e77700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d00c6810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53c00098f0 tx=0x7f53c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe3549c4405aab8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53c7fff700 1 -- 172.21.15.161:0/2787698139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000b8a0 con 0x7f53d00aea70 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53c7fff700 1 -- 172.21.15.161:0/2787698139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000ba00 con 0x7f53d00aea70 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53c7fff700 1 -- 172.21.15.161:0/2787698139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000bd90 con 0x7f53d00aea70 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 -- 172.21.15.161:0/2787698139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 msgr2=0x7f53d00c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d00c6810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53c00098f0 tx=0x7f53c0009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 -- 172.21.15.161:0/2787698139 shutdown_connections 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d006a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 --2- 172.21.15.161:0/2787698139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d00c6810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 -- 172.21.15.161:0/2787698139 >> 172.21.15.161:0/2787698139 conn(0x7f53d00cfd70 msgr2=0x7f53d00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 -- 172.21.15.161:0/2787698139 shutdown_connections 2023-08-10T10:29:21.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.299+0000 7f53d78dc700 1 -- 172.21.15.161:0/2787698139 wait complete. 2023-08-10T10:29:21.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.300+0000 7f53d78dc700 1 Processor -- start 2023-08-10T10:29:21.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.300+0000 7f53d78dc700 1 -- start start 2023-08-10T10:29:21.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d006a190 0x7f53d0158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d0152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d01594d0 con 0x7f53d00aea70 2023-08-10T10:29:21.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0159770 con 0x7f53d006a190 2023-08-10T10:29:21.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d78dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0159a50 con 0x7f53d0071940 2023-08-10T10:29:21.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60492/0 (socket says 172.21.15.161:60492) 2023-08-10T10:29:21.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 -- 172.21.15.161:0/504172383 learned_addr learned my addr 172.21.15.161:0/504172383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5678700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d006a190 0x7f53d0158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d4e77700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d0152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 -- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 msgr2=0x7f53d0152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d0152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 -- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d006a190 msgr2=0x7f53d0158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d006a190 0x7f53d0158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.301+0000 7f53d5e79700 1 -- 172.21.15.161:0/504172383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009550 con 0x7f53d00aea70 2023-08-10T10:29:21.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53d5e79700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53c8007e60 tx=0x7f53c800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53c5ffb700 1 -- 172.21.15.161:0/504172383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800ed30 con 0x7f53d00aea70 2023-08-10T10:29:21.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53c5ffb700 1 -- 172.21.15.161:0/504172383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8014420 con 0x7f53d00aea70 2023-08-10T10:29:21.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0159d30 con 0x7f53d00aea70 2023-08-10T10:29:21.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53c5ffb700 1 -- 172.21.15.161:0/504172383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80147d0 con 0x7f53d00aea70 2023-08-10T10:29:21.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.302+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d015a2f0 con 0x7f53d00aea70 2023-08-10T10:29:21.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.303+0000 7f53c5ffb700 1 -- 172.21.15.161:0/504172383 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53c8014930 con 0x7f53d00aea70 2023-08-10T10:29:21.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.304+0000 7f53c5ffb700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 0x7f53b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.304+0000 7f53c5ffb700 1 -- 172.21.15.161:0/504172383 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c8089b00 con 0x7f53d00aea70 2023-08-10T10:29:21.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.304+0000 7f53d5678700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 0x7f53b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.304+0000 7f53d5678700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 0x7f53b406d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007fd0 tx=0x7f53cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 Processor -- start 2023-08-10T10:29:21.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 -- start start 2023-08-10T10:29:21.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7283980 0x55add7283d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add72ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add71fed70 con 0x55add7281070 2023-08-10T10:29:21.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add71db540 con 0x55add72ade50 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.306+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55add71d8e60 con 0x55add7283980 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60496/0 (socket says 172.21.15.161:60496) 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 -- 172.21.15.161:0/975667421 learned_addr learned my addr 172.21.15.161:0/975667421 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d5678700 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7283980 0x55add7283d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d5e79700 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add72ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 -- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7283980 msgr2=0x55add7283d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7283980 0x55add7283d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 -- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 msgr2=0x55add72ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add72ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 -- 172.21.15.161:0/975667421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55add70555e0 con 0x55add7281070 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53d4e77700 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009c40 tx=0x7f53c0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5bced6a163eb12 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53baffd700 1 -- 172.21.15.161:0/975667421 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0020040 con 0x55add7281070 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53baffd700 1 -- 172.21.15.161:0/975667421 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000bd70 con 0x55add7281070 2023-08-10T10:29:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.307+0000 7f53baffd700 1 -- 172.21.15.161:0/975667421 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000b8a0 con 0x55add7281070 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- 172.21.15.161:0/975667421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 msgr2=0x55add72aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009c40 tx=0x7f53c0008030 comp rx=0 tx=0).stop 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- 172.21.15.161:0/975667421 shutdown_connections 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add72ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7283980 0x55add7283d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/975667421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7281070 0x55add72aa2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- 172.21.15.161:0/975667421 >> 172.21.15.161:0/975667421 conn(0x55add71e0c80 msgr2=0x55add72c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- 172.21.15.161:0/975667421 shutdown_connections 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- 172.21.15.161:0/975667421 wait complete. 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 -- start start 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.308+0000 7f53e3a75b80 1 Processor -- start 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7281070 0x55add72b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add72ade50 0x55add72a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add71d4750 con 0x55add7283980 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add7173a70 con 0x55add7281070 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55add7173770 con 0x55add72ade50 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 10 client.0 _ll_register_callbacks cb 0x55add7171630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60504/0 (socket says 172.21.15.161:60504) 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 -- 172.21.15.161:0/476474053 learned_addr learned my addr 172.21.15.161:0/476474053 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d5e79700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add72ade50 0x55add72a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d5678700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7281070 0x55add72b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 -- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add72ade50 msgr2=0x55add72a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add72ade50 0x55add72a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 -- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7281070 msgr2=0x55add72b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7281070 0x55add72b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 -- 172.21.15.161:0/476474053 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d006ae60 con 0x55add7283980 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53d4e77700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c0013000 tx=0x7f53c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f906448030f7f15 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53affff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-08-10T10:29:21.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0020040 con 0x55add7283980 2023-08-10T10:29:21.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c00043f0 con 0x55add7283980 2023-08-10T10:29:21.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.310+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55add7276010 con 0x55add7283980 2023-08-10T10:29:21.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53c000bee0 con 0x55add7283980 2023-08-10T10:29:21.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 10 client.4680 fetch_fsmap learned FSMap version 8 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55add7001d90 con 0x55add7283980 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55add7276010 con 0x55add7283980 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f53c00036a0 con 0x55add7283980 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 20 client.4680 populate_metadata read hostname 'smithi161' 2023-08-10T10:29:21.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72ca4e0 0x55add72abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 4 client.4680 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 --> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55add7252b70 con 0x55add72ca4e0 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53d5678700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72ca4e0 0x55add72abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53affff700 10 client.4680 ms_handle_connect on v2:172.21.15.175:6833/2919122780 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.311+0000 7f53d5678700 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72ca4e0 0x55add72abae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=677eb1d43fa095af server_cookie=19b5cb477592b531 in_seq=0 out_seq=0 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53affff700 1 -- 172.21.15.161:0/476474053 <== mds.0 v2:172.21.15.175:6833/2919122780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55add7252b70 con 0x55add72ca4e0 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53affff700 10 client.4680 handle_command_reply: tid=0 2023-08-10T10:29:21.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 client.4680 shutdown 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 msgr2=0x55add72a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c0013000 tx=0x7f53c00047c0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 shutdown_connections 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72ca4e0 0x55add72abae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add72ade50 0x55add72a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53affff700 0 client.4680 ms_handle_reset on v2:172.21.15.175:6833/2919122780 2023-08-10T10:29:21.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7281070 0x55add72b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/476474053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72a5780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 >> 172.21.15.161:0/476474053 conn(0x55add71e0c80 msgr2=0x55add7283d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.312+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 shutdown_connections 2023-08-10T10:29:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.313+0000 7f53e3a75b80 1 -- 172.21.15.161:0/476474053 wait complete. 2023-08-10T10:29:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.313+0000 7f53e3a75b80 20 client.4680 trim_cache size 0 max 16384 2023-08-10T10:29:21.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.330+0000 7f53e3a75b80 1 Processor -- start 2023-08-10T10:29:21.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.330+0000 7f53e3a75b80 1 -- start start 2023-08-10T10:29:21.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add727f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add70578d0 con 0x55add7283980 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add72a5ad0 con 0x55add72ade50 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55add727ec80 con 0x55add7281070 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60512/0 (socket says 172.21.15.161:60512) 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 -- 172.21.15.161:0/3294648893 learned_addr learned my addr 172.21.15.161:0/3294648893 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d5678700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d5e79700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add727f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 -- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 msgr2=0x55add727e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 -- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 msgr2=0x55add727f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add727f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 -- 172.21.15.161:0/3294648893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55add6feac10 con 0x55add7283980 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d5e79700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add727f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:21.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d5678700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53d4e77700 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53c002e990 tx=0x7f53c000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34ea38ff2717146 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53bb7fe700 1 -- 172.21.15.161:0/3294648893 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0020040 con 0x55add7283980 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53bb7fe700 1 -- 172.21.15.161:0/3294648893 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0003b60 con 0x55add7283980 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.331+0000 7f53bb7fe700 1 -- 172.21.15.161:0/3294648893 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00036a0 con 0x55add7283980 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- 172.21.15.161:0/3294648893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 msgr2=0x55add72ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53c002e990 tx=0x7f53c000b050 comp rx=0 tx=0).stop 2023-08-10T10:29:21.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- 172.21.15.161:0/3294648893 shutdown_connections 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add72ade50 0x55add727f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/3294648893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add7283980 0x55add72ca8c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- 172.21.15.161:0/3294648893 >> 172.21.15.161:0/3294648893 conn(0x55add71e0c80 msgr2=0x55add72a5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- 172.21.15.161:0/3294648893 shutdown_connections 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- 172.21.15.161:0/3294648893 wait complete. 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 -- start start 2023-08-10T10:29:21.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.332+0000 7f53e3a75b80 1 Processor -- start 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7283980 0x55add72ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add7330550 con 0x55add72ade50 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55add72cbf40 con 0x55add7283980 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55add72e1a40 con 0x55add7281070 2023-08-10T10:29:21.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53e3a75b80 10 client.0 _ll_register_callbacks cb 0x55add7171630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53d5e79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53d5e79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60520/0 (socket says 172.21.15.161:60520) 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.333+0000 7f53d5e79700 1 -- 172.21.15.161:0/4253509527 learned_addr learned my addr 172.21.15.161:0/4253509527 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5678700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d4e77700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7283980 0x55add72ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 -- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 msgr2=0x55add727e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 -- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7283980 msgr2=0x55add72ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7283980 0x55add72ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 -- 172.21.15.161:0/4253509527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55add7001d90 con 0x55add72ade50 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53d5e79700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e710 tx=0x7f53c801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab907e0688692a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8058010 con 0x55add72ade50 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c8060bc0 con 0x55add72ade50 2023-08-10T10:29:21.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53c000bd70 con 0x55add72ade50 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53c8077120 con 0x55add72ade50 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 10 client.4686 fetch_fsmap learned FSMap version 8 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55add7028200 con 0x55add72ade50 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000bd70 con 0x55add72ade50 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f53c8060730 con 0x55add72ade50 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:29:21.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 20 client.4686 populate_metadata read hostname 'smithi161' 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72c9140 0x55add732edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 4 client.4686 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.334+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 --> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55add71cd730 con 0x55add72c9140 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53d5678700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72c9140 0x55add732edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53affff700 10 client.4686 ms_handle_connect on v2:172.21.15.175:6833/2919122780 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53d5678700 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72c9140 0x55add732edc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61bda4b64c48450 server_cookie=5392ed1bd7cf3a6b in_seq=0 out_seq=0 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53affff700 1 -- 172.21.15.161:0/4253509527 <== mds.0 v2:172.21.15.175:6833/2919122780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55add71cd730 con 0x55add72c9140 2023-08-10T10:29:21.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53affff700 10 client.4686 handle_command_reply: tid=0 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 client.4686 shutdown 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 msgr2=0x55add72ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e710 tx=0x7f53c801e000 comp rx=0 tx=0).stop 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 shutdown_connections 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:6833/2919122780,v1:172.21.15.175:6835/2919122780] conn(0x55add72c9140 0x55add732edc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55add72ade50 0x55add72ad820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55add7281070 0x55add727e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 --2- 172.21.15.161:0/4253509527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55add7283980 0x55add72ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 >> 172.21.15.161:0/4253509527 conn(0x55add71e0c80 msgr2=0x55add72c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53affff700 0 client.4686 ms_handle_reset on v2:172.21.15.175:6833/2919122780 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 shutdown_connections 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.335+0000 7f53e3a75b80 1 -- 172.21.15.161:0/4253509527 wait complete. 2023-08-10T10:29:21.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53e3a75b80 20 client.4686 trim_cache size 0 max 16384 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e", 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4306, 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-08-10T10:29:21.350 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 17.847318794, 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 8, 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 24, 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 24, 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 22.923300155 2023-08-10T10:29:21.351 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-08-10T10:29:21.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 msgr2=0x7f53b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 0x7f53b406d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007fd0 tx=0x7f53cc009040 comp rx=0 tx=0).stop 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 msgr2=0x7f53d01529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53c8007e60 tx=0x7f53c800e3c0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 shutdown_connections 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f53b406ace0 0x7f53b406d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00aea70 0x7f53d01529d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d006a190 0x7f53d0158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 --2- 172.21.15.161:0/504172383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d0071940 0x7f53d0152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 >> 172.21.15.161:0/504172383 conn(0x7f53d00cfd70 msgr2=0x7f53d01612b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 shutdown_connections 2023-08-10T10:29:21.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.336+0000 7f53d78dc700 1 -- 172.21.15.161:0/504172383 wait complete. 2023-08-10T10:29:21.355 INFO:teuthology.run_tasks:Running task kclient... 2023-08-10T10:29:21.385 INFO:tasks.kclient:Mounting kernel clients... 2023-08-10T10:29:21.386 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-10T10:29:21.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.387 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-08-10T10:29:21.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-08-10T10:29:21.473 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-08-10T10:29:21.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:29:21.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.474 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-08-10T10:29:21.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-08-10T10:29:21.598 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-08-10T10:29:21.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:29:21.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.600 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-08-10T10:29:21.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-08-10T10:29:21.697 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2023-08-10T10:29:21.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:29:21.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.700 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-08-10T10:29:21.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:21.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-08-10T10:29:21.829 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2023-08-10T10:29:21.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:29:21.832 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-10T10:29:21.832 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:29:21.833 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:29:21.833 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:29:21.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.953+0000 7f1477b5d700 1 Processor -- start 2023-08-10T10:29:21.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.954+0000 7f1477b5d700 1 -- start start 2023-08-10T10:29:21.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f1477b5d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 0x7f14700cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f1477b5d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14700c52c0 0x7f14700c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f1477b5d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700cc780 con 0x7f147015b050 2023-08-10T10:29:21.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f1477b5d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700ccd40 con 0x7f14700c52c0 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f1477b5d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700ce1d0 con 0x7f14700cd7e0 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14700c52c0 0x7f14700c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14700c52c0 0x7f14700c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60528/0 (socket says 172.21.15.161:60528) 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 -- 172.21.15.161:0/1477609240 learned_addr learned my addr 172.21.15.161:0/1477609240 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14750f8700 1 --2- 172.21.15.161:0/1477609240 >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 0x7f14700cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 -- 172.21.15.161:0/1477609240 >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 msgr2=0x7f14700cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 --2- 172.21.15.161:0/1477609240 >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 0x7f14700cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 -- 172.21.15.161:0/1477609240 >> v1:172.21.15.175:6789/0 conn(0x7f147015b050 legacy=0x7f14700d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 -- 172.21.15.161:0/1477609240 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700cca60 con 0x7f14700c52c0 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14750f8700 1 --2- 172.21.15.161:0/1477609240 >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 0x7f14700cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14760fa700 1 --2- 172.21.15.161:0/1477609240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f14700c56a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f147006dc80 tx=0x7f146800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd4b908462eef49 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14748f7700 1 -- 172.21.15.161:0/1477609240 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800e070 con 0x7f14700c52c0 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14748f7700 1 -- 172.21.15.161:0/1477609240 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468003a20 con 0x7f14700c52c0 2023-08-10T10:29:21.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.955+0000 7f14748f7700 1 -- 172.21.15.161:0/1477609240 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468003dd0 con 0x7f14700c52c0 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 -- 172.21.15.161:0/1477609240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 msgr2=0x7f14700c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 --2- 172.21.15.161:0/1477609240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f14700c56a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f147006dc80 tx=0x7f146800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 -- 172.21.15.161:0/1477609240 shutdown_connections 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 --2- 172.21.15.161:0/1477609240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f14700c56a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 --2- 172.21.15.161:0/1477609240 >> v2:172.21.15.175:3300/0 conn(0x7f14700cd7e0 0x7f14700cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 -- 172.21.15.161:0/1477609240 >> 172.21.15.161:0/1477609240 conn(0x7f147009a150 msgr2=0x7f14700d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:21.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 -- 172.21.15.161:0/1477609240 shutdown_connections 2023-08-10T10:29:21.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.956+0000 7f1477b5d700 1 -- 172.21.15.161:0/1477609240 wait complete. 2023-08-10T10:29:21.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.958+0000 7f1477b5d700 1 Processor -- start 2023-08-10T10:29:21.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.958+0000 7f1477b5d700 1 -- start start 2023-08-10T10:29:21.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 0x7f147009d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147015b050 0x7f147009dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14701598a0 con 0x7f14700c52c0 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147009e230 con 0x7f14700cd7e0 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147009e510 con 0x7f147015b050 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60530/0 (socket says 172.21.15.161:60530) 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 -- 172.21.15.161:0/671099287 learned_addr learned my addr 172.21.15.161:0/671099287 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14750f8700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 0x7f147009d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 -- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147015b050 msgr2=0x7f147009dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147015b050 0x7f147009dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 -- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 msgr2=0x7f147009d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 0x7f147009d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 -- 172.21.15.161:0/671099287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009b30 con 0x7f14700c52c0 2023-08-10T10:29:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14750f8700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 0x7f147009d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14758f9700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f146000b450 tx=0x7f146000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460004020 con 0x7f14700c52c0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460004180 con 0x7f14700c52c0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147009e7f0 con 0x7f14700c52c0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460004530 con 0x7f14700c52c0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.959+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14700b4b10 con 0x7f14700c52c0 2023-08-10T10:29:21.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.960+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700b4d30 con 0x7f14700c52c0 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.961+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14600036d0 con 0x7f14700c52c0 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.961+0000 7f14667fc700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 0x7f145406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.961+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1460088d00 con 0x7f14700c52c0 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.961+0000 7f14750f8700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 0x7f145406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.961+0000 7f14750f8700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 0x7f145406d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f14700b6aa0 tx=0x7f146c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:21.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:21.965+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1460053db0 con 0x7f14700c52c0 2023-08-10T10:29:22.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.196+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14700744e0 con 0x7f14700c52c0 2023-08-10T10:29:22.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.197+0000 7f14667fc700 1 -- 172.21.15.161:0/671099287 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1460015070 con 0x7f14700c52c0 2023-08-10T10:29:22.198 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:29:22.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 msgr2=0x7f145406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 0x7f145406d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f14700b6aa0 tx=0x7f146c008040 comp rx=0 tx=0).stop 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 msgr2=0x7f1470159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f146000b450 tx=0x7f146000b810 comp rx=0 tx=0).stop 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 shutdown_connections 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f145406ace0 0x7f145406d1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147015b050 0x7f147009dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:22.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14700c52c0 0x7f1470159360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:22.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 --2- 172.21.15.161:0/671099287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14700cd7e0 0x7f147009d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:22.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 >> 172.21.15.161:0/671099287 conn(0x7f147009a150 msgr2=0x7f14700c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:22.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 shutdown_connections 2023-08-10T10:29:22.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:22.199+0000 7f1477b5d700 1 -- 172.21.15.161:0/671099287 wait complete. 2023-08-10T10:29:22.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:29:22.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:29:22.213 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-08-10T10:29:22.213 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:29:22.213 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:29:22.213 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:29:22.214 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:29:22.214 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:29:22.214 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:29:22.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.215 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 41405sec preferred_lft 41405sec 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::95b4:a538:eaa3:f29/64 scope link noprefixroute 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:22.238 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.239 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:22.239 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:22.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:29:22.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-08-10T10:29:22.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-08-10T10:29:22.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:29:22.241 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:22.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.399 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:29:22.427 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-08-10T10:29:22.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.428 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-08-10T10:29:22.498 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-08-10T10:29:22.499 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:29:22.499 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:29:22.500 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:29:22.500 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:29:22.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.501 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:22.501 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:22.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:29:22.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:29:22.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:29:22.502 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:22.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.763 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-08-10T10:29:22.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.781 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-08-10T10:29:22.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.838 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:22.839 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:22.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:29:22.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-10T10:29:22.839 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:22.932 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-10T10:29:22.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:22.933 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:22.933 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:22.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-10T10:29:22.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:29:22.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-10T10:29:22.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-10T10:29:22.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-10T10:29:22.934 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:23.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.148 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:23.148 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:23.148 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-08-10T10:29:23.148 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:29:23.149 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:23.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:23.249 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:29:23.269 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:29:23.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:23.270 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:29:23.326 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:29:23.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.327 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:23.420 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:23.421 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 0@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 0@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-08-10T10:29:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-08-10T10:29:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e" will pass to kernel 2023-08-10T10:29:23.556 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:29:23.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:29:23.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.588 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:client4478 2023-08-10T10:29:23.676 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:23.677 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:23.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.696 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:client4478 2023-08-10T10:29:23.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.785 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:23.834 INFO:teuthology.orchestra.run.smithi161.stdout:client4478 2023-08-10T10:29:23.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:23.835 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.client4478/status') 2023-08-10T10:29:23.888 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4478 (3)172.21.15.161:0/3562491343 2023-08-10T10:29:23.889 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-08-10T10:29:23.889 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-08-10T10:29:23.890 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-08-10T10:29:23.890 INFO:teuthology.orchestra.run.smithi161.stderr:71 bytes copied, 2.2019e-05 s, 3.2 MB/s 2023-08-10T10:29:23.890 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-08-10T10:29:23.890 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:29:23.891 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:29:23.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:29:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.010+0000 7f8856af7700 1 Processor -- start 2023-08-10T10:29:24.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.010+0000 7f8856af7700 1 -- start start 2023-08-10T10:29:24.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.011+0000 7f8856af7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f885006a190 0x7f88500c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.011+0000 7f8856af7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8850071940 0x7f885006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.011+0000 7f8856af7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88500cf6a0 con 0x7f88500aea70 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.011+0000 7f8856af7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885006eb80 con 0x7f885006a190 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.011+0000 7f8856af7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500af510 con 0x7f8850071940 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f885006a190 0x7f88500c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f885006a190 0x7f88500c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60542/0 (socket says 172.21.15.161:60542) 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 -- 172.21.15.161:0/736704018 learned_addr learned my addr 172.21.15.161:0/736704018 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:24.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8855094700 1 --2- 172.21.15.161:0/736704018 >> v2:172.21.15.175:3300/0 conn(0x7f8850071940 0x7f885006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 -- 172.21.15.161:0/736704018 >> v2:172.21.15.175:3300/0 conn(0x7f8850071940 msgr2=0x7f885006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 --2- 172.21.15.161:0/736704018 >> v2:172.21.15.175:3300/0 conn(0x7f8850071940 0x7f885006a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 -- 172.21.15.161:0/736704018 >> v1:172.21.15.175:6789/0 conn(0x7f88500aea70 legacy=0x7f885006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 -- 172.21.15.161:0/736704018 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885006ae60 con 0x7f885006a190 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f8854893700 1 --2- 172.21.15.161:0/736704018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f885006a190 0x7f88500c6810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f885006c330 tx=0x7f8844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a6787493c4d125 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f884f7fe700 1 -- 172.21.15.161:0/736704018 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844004230 con 0x7f885006a190 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f884f7fe700 1 -- 172.21.15.161:0/736704018 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844004390 con 0x7f885006a190 2023-08-10T10:29:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.012+0000 7f884f7fe700 1 -- 172.21.15.161:0/736704018 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440036a0 con 0x7f885006a190 2023-08-10T10:29:24.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 -- 172.21.15.161:0/736704018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f885006a190 msgr2=0x7f88500c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 --2- 172.21.15.161:0/736704018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f885006a190 0x7f88500c6810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f885006c330 tx=0x7f8844009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 -- 172.21.15.161:0/736704018 shutdown_connections 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 --2- 172.21.15.161:0/736704018 >> v2:172.21.15.175:3300/0 conn(0x7f8850071940 0x7f885006a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 --2- 172.21.15.161:0/736704018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f885006a190 0x7f88500c6810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 -- 172.21.15.161:0/736704018 >> 172.21.15.161:0/736704018 conn(0x7f88500cfd70 msgr2=0x7f88500d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 -- 172.21.15.161:0/736704018 shutdown_connections 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.013+0000 7f8856af7700 1 -- 172.21.15.161:0/736704018 wait complete. 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.014+0000 7f8856af7700 1 Processor -- start 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.014+0000 7f8856af7700 1 -- start start 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f885006a190 0x7f8850143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8850071940 0x7f88501540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501442a0 con 0x7f88500aea70 2023-08-10T10:29:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850154630 con 0x7f885006a190 2023-08-10T10:29:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8856af7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8850154890 con 0x7f8850071940 2023-08-10T10:29:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8855094700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8855094700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60552/0 (socket says 172.21.15.161:60552) 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8855094700 1 -- 172.21.15.161:0/2946465501 learned_addr learned my addr 172.21.15.161:0/2946465501 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f8854893700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f885006a190 0x7f8850143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.015+0000 7f884ffff700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8850071940 0x7f88501540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 -- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8850071940 msgr2=0x7f88501540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8850071940 0x7f88501540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 -- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f885006a190 msgr2=0x7f8850143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f885006a190 0x7f8850143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 -- 172.21.15.161:0/2946465501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009550 con 0x7f88500aea70 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8855094700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8848007e40 tx=0x7f884800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800ed30 con 0x7f88500aea70 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848014420 con 0x7f88500aea70 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850154b70 con 0x7f88500aea70 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480147d0 con 0x7f88500aea70 2023-08-10T10:29:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.016+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8850155130 con 0x7f88500aea70 2023-08-10T10:29:24.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.017+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88500af150 con 0x7f88500aea70 2023-08-10T10:29:24.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.017+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8848014930 con 0x7f88500aea70 2023-08-10T10:29:24.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.018+0000 7f884d7fa700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 0x7f883406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:24.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.018+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8848089b70 con 0x7f88500aea70 2023-08-10T10:29:24.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.018+0000 7f8854893700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 0x7f883406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:24.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.018+0000 7f8854893700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 0x7f883406d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8844009130 tx=0x7f8844008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:24.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.022+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8848054cd0 con 0x7f88500aea70 2023-08-10T10:29:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.254+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88500744e0 con 0x7f88500aea70 2023-08-10T10:29:24.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.255+0000 7f884d7fa700 1 -- 172.21.15.161:0/2946465501 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88480582f0 con 0x7f88500aea70 2023-08-10T10:29:24.256 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:29:24.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 msgr2=0x7f883406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:24.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 0x7f883406d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8844009130 tx=0x7f8844008030 comp rx=0 tx=0).stop 2023-08-10T10:29:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 msgr2=0x7f88501524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8848007e40 tx=0x7f884800e3c0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 shutdown_connections 2023-08-10T10:29:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f883406ace0 0x7f883406d1a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88500aea70 0x7f88501524f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f885006a190 0x7f8850143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 --2- 172.21.15.161:0/2946465501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8850071940 0x7f88501540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 >> 172.21.15.161:0/2946465501 conn(0x7f88500cfd70 msgr2=0x7f885006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 shutdown_connections 2023-08-10T10:29:24.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:24.257+0000 7f8856af7700 1 -- 172.21.15.161:0/2946465501 wait complete. 2023-08-10T10:29:24.271 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:29:24.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:29:24.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-08-10T10:29:24.271 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-10T10:29:24.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:29:24.272 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:29:24.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:29:24.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:29:24.272 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:29:24.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.273 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-08-10T10:29:24.290 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:24.290 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:24.290 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:24.290 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:24.291 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 41403sec preferred_lft 41403sec 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::95b4:a538:eaa3:f29/64 scope link noprefixroute 2023-08-10T10:29:24.292 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 3a:b2:36:50:3f:9b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c00e:87ff:fed5:d247/64 scope link tentative 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:29:24.293 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 3a:b2:36:50:3f:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:29:24.294 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::38b2:36ff:fe50:3f9b/64 scope link tentative 2023-08-10T10:29:24.294 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.294 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:29:24.356 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-08-10T10:29:24.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.358 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-08-10T10:29:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-08-10T10:29:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:29:24.418 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:29:24.418 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:29:24.418 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:29:24.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.419 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:24.420 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:24.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:29:24.421 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:29:24.421 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:29:24.422 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:24.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.522 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-08-10T10:29:24.539 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:29:24.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.540 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-08-10T10:29:24.595 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-10T10:29:24.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.596 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:24.597 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:24.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:29:24.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-10T10:29:24.597 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:24.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.690 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:29:24.728 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:24.728 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:24.728 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:24.729 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.729 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:24.729 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.729 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:24.729 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 4a:12:a4:db:82:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:29:24.730 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:29:24.730 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.730 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::4812:a4ff:fedb:823f/64 scope link 2023-08-10T10:29:24.730 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:29:24.821 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:24.822 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:24.822 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:24.822 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.822 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 4a:12:a4:db:82:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::4812:a4ff:fedb:823f/64 scope link 2023-08-10T10:29:24.823 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:24.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-10T10:29:24.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:24.834 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:24.834 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:24.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-10T10:29:24.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:29:24.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-10T10:29:24.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-10T10:29:24.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-10T10:29:24.835 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:25.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.080 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:29:25.080 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:29:25.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2023-08-10T10:29:25.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:29:25.080 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:29:25.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:25.206 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-10T10:29:25.234 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:29:25.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:25.235 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:29:25.291 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-08-10T10:29:25.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.291 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:25.376 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:25.376 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:25.401 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 2@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:25.402 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:25.403 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:25.480 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:25.480 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 2@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:25.481 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:25.482 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-08-10T10:29:25.482 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-08-10T10:29:25.482 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e" will pass to kernel 2023-08-10T10:29:25.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:29:25.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:29:25.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.511 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:25.583 INFO:teuthology.orchestra.run.smithi161.stdout:client4621 2023-08-10T10:29:25.584 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:25.584 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:25.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.641 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:25.712 INFO:teuthology.orchestra.run.smithi161.stdout:client4621 2023-08-10T10:29:25.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.713 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:25.785 INFO:teuthology.orchestra.run.smithi161.stdout:client4621 2023-08-10T10:29:25.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:25.786 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.client4621/status') 2023-08-10T10:29:25.865 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4621 (3)172.21.15.161:0/1848759878 2023-08-10T10:29:25.865 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-08-10T10:29:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-08-10T10:29:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-08-10T10:29:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:71 bytes copied, 2.3301e-05 s, 3.0 MB/s 2023-08-10T10:29:25.866 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-10T10:29:25.867 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:29:25.867 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:29:25.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:29:26.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.025+0000 7f1cf0ef2700 1 Processor -- start 2023-08-10T10:29:26.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.025+0000 7f1cf0ef2700 1 -- start start 2023-08-10T10:29:26.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cf0ef2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1cec070c50 0x7f1cec071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cf0ef2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 0x7f1cec06a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cf0ef2700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec071570 con 0x7f1cec0cf540 2023-08-10T10:29:26.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cf0ef2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0cd940 con 0x7f1cec070c50 2023-08-10T10:29:26.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cf0ef2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec06d730 con 0x7f1cec0cb610 2023-08-10T10:29:26.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1cec070c50 0x7f1cec071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce9d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1cec0cf540 0x7f1cec06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37566/0 (socket says 172.21.15.161:37566) 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1cec070c50 0x7f1cec071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60560/0 (socket says 172.21.15.161:60560) 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce9d9b700 1 -- 172.21.15.161:0/1158141684 learned_addr learned my addr 172.21.15.161:0/1158141684 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cead9d700 1 --2- 172.21.15.161:0/1158141684 >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 0x7f1cec06a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 -- 172.21.15.161:0/1158141684 >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 msgr2=0x7f1cec06a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 --2- 172.21.15.161:0/1158141684 >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 0x7f1cec06a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 -- 172.21.15.161:0/1158141684 >> v1:172.21.15.161:6789/0 conn(0x7f1cec0cf540 legacy=0x7f1cec06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 -- 172.21.15.161:0/1158141684 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec06da10 con 0x7f1cec070c50 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce959a700 1 -- 172.21.15.161:0/1158141684 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109414845 0 0) 0x7f1cec071570 con 0x7f1cec0cf540 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cead9d700 1 --2- 172.21.15.161:0/1158141684 >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 0x7f1cec06a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1cea59c700 1 --2- 172.21.15.161:0/1158141684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec071030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cec06e1f0 tx=0x7f1cdc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6851e978122a6a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce959a700 1 -- 172.21.15.161:0/1158141684 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc011830 con 0x7f1cec070c50 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce959a700 1 -- 172.21.15.161:0/1158141684 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc011990 con 0x7f1cec070c50 2023-08-10T10:29:26.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.026+0000 7f1ce959a700 1 -- 172.21.15.161:0/1158141684 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc011d20 con 0x7f1cec070c50 2023-08-10T10:29:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/1158141684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 msgr2=0x7f1cec071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/1158141684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec071030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cec06e1f0 tx=0x7f1cdc009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/1158141684 shutdown_connections 2023-08-10T10:29:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/1158141684 >> v2:172.21.15.175:3300/0 conn(0x7f1cec0cb610 0x7f1cec06a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/1158141684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec071030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/1158141684 >> 172.21.15.161:0/1158141684 conn(0x7f1cec0cfd70 msgr2=0x7f1cec0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/1158141684 shutdown_connections 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.027+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/1158141684 wait complete. 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.028+0000 7f1cf0ef2700 1 Processor -- start 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.028+0000 7f1cf0ef2700 1 -- start start 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cec0cb610 0x7f1cec12d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cec0cf540 0x7f1cec15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b4390 con 0x7f1cec070c50 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b4670 con 0x7f1cec0cb610 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cf0ef2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b4950 con 0x7f1cec0cf540 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cea59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cea59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60568/0 (socket says 172.21.15.161:60568) 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cea59c700 1 -- 172.21.15.161:0/3715716100 learned_addr learned my addr 172.21.15.161:0/3715716100 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1cead9d700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cec0cf540 0x7f1cec15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.029+0000 7f1ce9d9b700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cec0cb610 0x7f1cec12d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 -- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cec0cf540 msgr2=0x7f1cec15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cec0cf540 0x7f1cec15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 -- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cec0cb610 msgr2=0x7f1cec12d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cec0cb610 0x7f1cec12d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 -- 172.21.15.161:0/3715716100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc0094a0 con 0x7f1cec070c50 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cea59c700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009b60 tx=0x7f1cdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0038a0 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc01e070 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0b4c30 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc003c00 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.030+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec15abf0 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.031+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0b44d0 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.031+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cdc02d450 con 0x7f1cec070c50 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.032+0000 7f1cdaffd700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 0x7f1ccc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.032+0000 7f1ce9d9b700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 0x7f1ccc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.032+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cdc08a510 con 0x7f1cec070c50 2023-08-10T10:29:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.032+0000 7f1ce9d9b700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 0x7f1ccc06d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cec13f1a0 tx=0x7f1ce0007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.036+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1cec0b44d0 con 0x7f1cec070c50 2023-08-10T10:29:26.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.273+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1cec0b44d0 con 0x7f1cec070c50 2023-08-10T10:29:26.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.274+0000 7f1cdaffd700 1 -- 172.21.15.161:0/3715716100 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1cec0b44d0 con 0x7f1cec070c50 2023-08-10T10:29:26.275 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:29:26.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 msgr2=0x7f1ccc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 0x7f1ccc06d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cec13f1a0 tx=0x7f1ce0007be0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 msgr2=0x7f1cec13e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009b60 tx=0x7f1cdc004750 comp rx=0 tx=0).stop 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 shutdown_connections 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1ccc06ace0 0x7f1ccc06d1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cec0cf540 0x7f1cec15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cec070c50 0x7f1cec13e340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 --2- 172.21.15.161:0/3715716100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cec0cb610 0x7f1cec12d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 >> 172.21.15.161:0/3715716100 conn(0x7f1cec0cfd70 msgr2=0x7f1cec143ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:26.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 shutdown_connections 2023-08-10T10:29:26.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:26.276+0000 7f1cf0ef2700 1 -- 172.21.15.161:0/3715716100 wait complete. 2023-08-10T10:29:26.289 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:29:26.290 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:29:26.290 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-08-10T10:29:26.290 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:29:26.290 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:29:26.290 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:29:26.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:29:26.291 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:29:26.291 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:29:26.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.292 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-08-10T10:29:26.312 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:26.313 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:26.314 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:29:26.315 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41320sec preferred_lft 41320sec 2023-08-10T10:29:26.315 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7994:a664:431b:c4a2/64 scope link noprefixroute 2023-08-10T10:29:26.315 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:26.315 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:29:26.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.316 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:26.316 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:26.316 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:29:26.316 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2023-08-10T10:29:26.317 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2023-08-10T10:29:26.317 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:29:26.317 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:26.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.498 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:29:26.527 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-08-10T10:29:26.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.529 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-08-10T10:29:26.606 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-08-10T10:29:26.606 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:29:26.607 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:29:26.607 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:29:26.607 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:29:26.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.607 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:26.608 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:26.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:29:26.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:29:26.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:29:26.609 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:26.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.876 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-08-10T10:29:26.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.894 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-08-10T10:29:26.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:26.950 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:26.950 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:26.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:29:26.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-10T10:29:26.951 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:27.043 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-10T10:29:27.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.044 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:27.044 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:27.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-10T10:29:27.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:29:27.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-10T10:29:27.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-10T10:29:27.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-10T10:29:27.046 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:27.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.234 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:27.234 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:27.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-08-10T10:29:27.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:29:27.235 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:27.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:27.339 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:29:27.363 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:29:27.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:27.364 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:29:27.420 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:29:27.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.421 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:27.518 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:27.519 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:27.626 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:27.627 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:27.627 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:27.627 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 1@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:27.627 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:27.628 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:27.628 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:27.628 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:27.654 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:27.655 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:27.655 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:27.655 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 1@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:27.655 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-08-10T10:29:27.656 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e" will pass to kernel 2023-08-10T10:29:27.673 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:29:27.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:29:27.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.700 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:27.771 INFO:teuthology.orchestra.run.smithi175.stdout:client4487 2023-08-10T10:29:27.772 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:27.773 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:27.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.830 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:27.901 INFO:teuthology.orchestra.run.smithi175.stdout:client4487 2023-08-10T10:29:27.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.901 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:27.974 INFO:teuthology.orchestra.run.smithi175.stdout:client4487 2023-08-10T10:29:27.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:27.975 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.client4487/status') 2023-08-10T10:29:28.054 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4487 (3)192.168.0.1:0/2146823849 2023-08-10T10:29:28.054 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2023-08-10T10:29:28.055 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2023-08-10T10:29:28.055 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2023-08-10T10:29:28.055 INFO:teuthology.orchestra.run.smithi175.stderr:69 bytes copied, 2.072e-05 s, 3.3 MB/s 2023-08-10T10:29:28.056 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-08-10T10:29:28.056 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:29:28.056 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:29:28.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:29:28.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.188+0000 7fe3c9b59700 1 Processor -- start 2023-08-10T10:29:28.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.188+0000 7fe3c9b59700 1 -- start start 2023-08-10T10:29:28.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c9b59700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3c41597b0 0x7fe3c4065e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c9b59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415d330 0x7fe3c415d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c9b59700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c415dca0 con 0x7fe3c415ded0 2023-08-10T10:29:28.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c9b59700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40cabf0 con 0x7fe3c41597b0 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c9b59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4159c40 con 0x7fe3c415d330 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3baffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3c41597b0 0x7fe3c4065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c37fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe3c415ded0 0x7fe3c40c9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37590/0 (socket says 172.21.15.161:37590) 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3baffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3c41597b0 0x7fe3c4065e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60586/0 (socket says 172.21.15.161:60586) 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.189+0000 7fe3c37fe700 1 -- 172.21.15.161:0/3316166848 learned_addr learned my addr 172.21.15.161:0/3316166848 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3baffd700 1 -- 172.21.15.161:0/3316166848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415d330 msgr2=0x7fe3c415d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:28.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3baffd700 1 --2- 172.21.15.161:0/3316166848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415d330 0x7fe3c415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3baffd700 1 -- 172.21.15.161:0/3316166848 >> v1:172.21.15.161:6789/0 conn(0x7fe3c415ded0 legacy=0x7fe3c40c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3baffd700 1 -- 172.21.15.161:0/3316166848 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40ca630 con 0x7fe3c41597b0 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/3316166848 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221432052 0 0) 0x7fe3c415dca0 con 0x7fe3c415ded0 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3baffd700 1 --2- 172.21.15.161:0/3316166848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c41597b0 0x7fe3c4065e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009840 tx=0x7fe3ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72818f3865bf0d88 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/3316166848 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac011830 con 0x7fe3c41597b0 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/3316166848 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac011990 con 0x7fe3c41597b0 2023-08-10T10:29:28.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/3316166848 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac011d20 con 0x7fe3c41597b0 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 -- 172.21.15.161:0/3316166848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c41597b0 msgr2=0x7fe3c4065e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/3316166848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c41597b0 0x7fe3c4065e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009840 tx=0x7fe3ac009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 -- 172.21.15.161:0/3316166848 shutdown_connections 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/3316166848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415d330 0x7fe3c415d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/3316166848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c41597b0 0x7fe3c4065e30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 -- 172.21.15.161:0/3316166848 >> 172.21.15.161:0/3316166848 conn(0x7fe3c40cf450 msgr2=0x7fe3c40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 -- 172.21.15.161:0/3316166848 shutdown_connections 2023-08-10T10:29:28.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.190+0000 7fe3c9b59700 1 -- 172.21.15.161:0/3316166848 wait complete. 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.192+0000 7fe3c9b59700 1 Processor -- start 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.192+0000 7fe3c9b59700 1 -- start start 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c41597b0 0x7fe3c41f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415ded0 0x7fe3c414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40c6a30 con 0x7fe3c415d330 2023-08-10T10:29:28.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40c2bf0 con 0x7fe3c41597b0 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c9b59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c41f3040 con 0x7fe3c415ded0 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60592/0 (socket says 172.21.15.161:60592) 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 -- 172.21.15.161:0/2794838183 learned_addr learned my addr 172.21.15.161:0/2794838183 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c3fff700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415ded0 0x7fe3c414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3c37fe700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c41597b0 0x7fe3c41f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 -- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415ded0 msgr2=0x7fe3c414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415ded0 0x7fe3c414d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 -- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c41597b0 msgr2=0x7fe3c41f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c41597b0 0x7fe3c41f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 -- 172.21.15.161:0/2794838183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac0094a0 con 0x7fe3c415d330 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.193+0000 7fe3baffd700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac014040 tx=0x7fe3ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0045f0 con 0x7fe3c415d330 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac01e070 con 0x7fe3c415d330 2023-08-10T10:29:28.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c40c2630 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003b00 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c40c6650 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.194+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c40c6b70 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.195+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3ac003c60 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.195+0000 7fe3c0ff9700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 0x7fe3a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.195+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3ac08a5d0 con 0x7fe3c415d330 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.195+0000 7fe3c37fe700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 0x7fe3a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:28.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.196+0000 7fe3c37fe700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 0x7fe3a406d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4000f60 tx=0x7fe3b4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:28.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.200+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe3c40c6b70 con 0x7fe3c415d330 2023-08-10T10:29:28.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.430+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3c40c6b70 con 0x7fe3c415d330 2023-08-10T10:29:28.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.430+0000 7fe3c0ff9700 1 -- 172.21.15.161:0/2794838183 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3c40c6b70 con 0x7fe3c415d330 2023-08-10T10:29:28.432 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 msgr2=0x7fe3a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 0x7fe3a406d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4000f60 tx=0x7fe3b4007be0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 msgr2=0x7fe3c4071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac014040 tx=0x7fe3ac004750 comp rx=0 tx=0).stop 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 shutdown_connections 2023-08-10T10:29:28.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe3a406ace0 0x7fe3a406d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c415ded0 0x7fe3c414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c41597b0 0x7fe3c41f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 --2- 172.21.15.161:0/2794838183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c415d330 0x7fe3c4071a10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.432+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 >> 172.21.15.161:0/2794838183 conn(0x7fe3c40cf450 msgr2=0x7fe3c414e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.433+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 shutdown_connections 2023-08-10T10:29:28.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:28.433+0000 7fe3c9b59700 1 -- 172.21.15.161:0/2794838183 wait complete. 2023-08-10T10:29:28.446 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:29:28.446 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:29:28.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-08-10T10:29:28.447 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-10T10:29:28.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:29:28.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:29:28.448 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:29:28.448 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:29:28.448 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:29:28.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.449 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-08-10T10:29:28.467 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:28.467 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:28.467 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:28.468 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41318sec preferred_lft 41318sec 2023-08-10T10:29:28.469 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7994:a664:431b:c4a2/64 scope link noprefixroute 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 7a:b6:ee:4d:78:ba brd ff:ff:ff:ff:ff:ff 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::4442:b4ff:feb0:fbc1/64 scope link 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.470 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:29:28.471 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 7a:b6:ee:4d:78:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:29:28.471 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::78b6:eeff:fe4d:78ba/64 scope link tentative 2023-08-10T10:29:28.471 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.471 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:29:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-08-10T10:29:28.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.535 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-08-10T10:29:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-08-10T10:29:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:29:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:29:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:29:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:29:28.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.595 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:28.596 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:28.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:29:28.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:29:28.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:29:28.597 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:28.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.699 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-08-10T10:29:28.716 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:29:28.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.717 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-08-10T10:29:28.772 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-10T10:29:28.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.773 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:28.773 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:28.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:29:28.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-10T10:29:28.774 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:28.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.866 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:29:28.900 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:28.901 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:28.901 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:28.901 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.902 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:28.902 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.902 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:28.903 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 46:0b:77:2d:1d:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:29:28.903 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:29:28.903 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.903 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::440b:77ff:fe2d:1d88/64 scope link tentative 2023-08-10T10:29:28.904 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:28.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:29:28.990 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:29:28.990 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 46:0b:77:2d:1d:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:29:28.991 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:28.992 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::440b:77ff:fe2d:1d88/64 scope link tentative 2023-08-10T10:29:28.992 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:29:29.003 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-10T10:29:29.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.004 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:29.004 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:29.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-10T10:29:29.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:29:29.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-10T10:29:29.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-10T10:29:29.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-10T10:29:29.006 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:29.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.252 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-08-10T10:29:29.252 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-08-10T10:29:29.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2023-08-10T10:29:29.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:29:29.253 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-08-10T10:29:29.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:29.362 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-10T10:29:29.385 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:29:29.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:29:29.386 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:29:29.441 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-08-10T10:29:29.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:29.527 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:29.527 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:29.551 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:29.551 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 3@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:29.552 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:29.584 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:29:29.584 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 3@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:29:29.585 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-08-10T10:29:29.586 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-08-10T10:29:29.586 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e" will pass to kernel 2023-08-10T10:29:29.587 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:29:29.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:29:29.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.621 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:29.692 INFO:teuthology.orchestra.run.smithi175.stdout:client4493 2023-08-10T10:29:29.692 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:29.693 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:29.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.754 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:29.830 INFO:teuthology.orchestra.run.smithi175.stdout:client4493 2023-08-10T10:29:29.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.831 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:29:29.902 INFO:teuthology.orchestra.run.smithi175.stdout:client4493 2023-08-10T10:29:29.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:29.903 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.client4493/status') 2023-08-10T10:29:29.982 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4493 (3)192.168.0.2:0/2848174820 2023-08-10T10:29:29.983 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2023-08-10T10:29:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2023-08-10T10:29:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2023-08-10T10:29:29.984 INFO:teuthology.orchestra.run.smithi175.stderr:69 bytes copied, 3.9205e-05 s, 1.8 MB/s 2023-08-10T10:29:29.984 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-10T10:29:30.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:30.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.135+0000 7f599fe07700 1 Processor -- start 2023-08-10T10:29:30.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.135+0000 7f599fe07700 1 -- start start 2023-08-10T10:29:30.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599fe07700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59980cad10 0x7f59980cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599fe07700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980cd940 con 0x7f59980cf540 2023-08-10T10:29:30.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599fe07700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599806d730 con 0x7f5998070c50 2023-08-10T10:29:30.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599fe07700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599806da10 con 0x7f59980cad10 2023-08-10T10:29:30.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599e3a4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59980cad10 0x7f59980cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599d3a2700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f59980cf540 0x7f59980ca600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37606/0 (socket says 172.21.15.161:37606) 2023-08-10T10:29:30.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599d3a2700 1 -- 172.21.15.161:0/2426325408 learned_addr learned my addr 172.21.15.161:0/2426325408 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599e3a4700 1 -- 172.21.15.161:0/2426325408 >> v1:172.21.15.175:6789/0 conn(0x7f5998070c50 legacy=0x7f5998071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599e3a4700 1 -- 172.21.15.161:0/2426325408 >> v1:172.21.15.161:6789/0 conn(0x7f59980cf540 legacy=0x7f59980ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599e3a4700 1 -- 172.21.15.161:0/2426325408 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599806dcf0 con 0x7f59980cad10 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.136+0000 7f599cba1700 1 -- 172.21.15.161:0/2426325408 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34309785 0 0) 0x7f59980cd940 con 0x7f59980cf540 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599e3a4700 1 --2- 172.21.15.161:0/2426325408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cad10 0x7f59980cb1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5990009d90 tx=0x7f599000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b77d95844f2822 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599cba1700 1 -- 172.21.15.161:0/2426325408 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000e070 con 0x7f59980cad10 2023-08-10T10:29:30.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599cba1700 1 -- 172.21.15.161:0/2426325408 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000bb90 con 0x7f59980cad10 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599cba1700 1 -- 172.21.15.161:0/2426325408 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990003a20 con 0x7f59980cad10 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 -- 172.21.15.161:0/2426325408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cad10 msgr2=0x7f59980cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 --2- 172.21.15.161:0/2426325408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cad10 0x7f59980cb1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5990009d90 tx=0x7f599000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 -- 172.21.15.161:0/2426325408 shutdown_connections 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 --2- 172.21.15.161:0/2426325408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cad10 0x7f59980cb1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 -- 172.21.15.161:0/2426325408 >> 172.21.15.161:0/2426325408 conn(0x7f59980cfd70 msgr2=0x7f59980d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:30.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 -- 172.21.15.161:0/2426325408 shutdown_connections 2023-08-10T10:29:30.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.137+0000 7f599fe07700 1 -- 172.21.15.161:0/2426325408 wait complete. 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 Processor -- start 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 -- start start 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5998070c50 0x7f599813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 0x7f59980b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599813d360 con 0x7f59980cf540 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980b58e0 con 0x7f59980cad10 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599fe07700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599813c6e0 con 0x7f5998070c50 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.139+0000 7f599e3a4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60608/0 (socket says 172.21.15.161:60608) 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 -- 172.21.15.161:0/2470947962 learned_addr learned my addr 172.21.15.161:0/2470947962 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:30.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599d3a2700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 0x7f59980b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599dba3700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5998070c50 0x7f599813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 -- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5998070c50 msgr2=0x7f599813c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5998070c50 0x7f599813c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 -- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 msgr2=0x7f59980b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 0x7f59980b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 -- 172.21.15.161:0/2470947962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990009a70 con 0x7f59980cf540 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599d3a2700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 0x7f59980b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599e3a4700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f599000b730 tx=0x7f5990004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990012840 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59900129a0 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599813c9c0 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990012d50 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.140+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599813cf80 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.141+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599813d4a0 con 0x7f59980cf540 2023-08-10T10:29:30.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.142+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f599001d420 con 0x7f59980cf540 2023-08-10T10:29:30.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.142+0000 7f598e7fc700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 0x7f597c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.142+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f599008bb10 con 0x7f59980cf540 2023-08-10T10:29:30.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.142+0000 7f599dba3700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 0x7f597c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.142+0000 7f599dba3700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 0x7f597c06d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5988004f30 tx=0x7f5988009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.146+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f599813d4a0 con 0x7f59980cf540 2023-08-10T10:29:30.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.340+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f599813d4a0 con 0x7f59980cf540 2023-08-10T10:29:30.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.342+0000 7f598e7fc700 1 -- 172.21.15.161:0/2470947962 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f599813d4a0 con 0x7f59980cf540 2023-08-10T10:29:30.343 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:30.344 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:30.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 msgr2=0x7f597c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 0x7f597c06d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5988004f30 tx=0x7f5988009040 comp rx=0 tx=0).stop 2023-08-10T10:29:30.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 msgr2=0x7f59981efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f599000b730 tx=0x7f5990004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 shutdown_connections 2023-08-10T10:29:30.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f597c06ace0 0x7f597c06d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59980cf540 0x7f59981efd90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5998070c50 0x7f599813c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 --2- 172.21.15.161:0/2470947962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59980cad10 0x7f59980b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 >> 172.21.15.161:0/2470947962 conn(0x7f59980cfd70 msgr2=0x7f5998143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:30.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 shutdown_connections 2023-08-10T10:29:30.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.344+0000 7f599fe07700 1 -- 172.21.15.161:0/2470947962 wait complete. 2023-08-10T10:29:30.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:30.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:30.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.481+0000 7f2fd4d70700 1 Processor -- start 2023-08-10T10:29:30.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.481+0000 7f2fd4d70700 1 -- start start 2023-08-10T10:29:30.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fd4d70700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fd015d380 0x7f2fd00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fd4d70700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00cb7d0 con 0x7f2fd00cdad0 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fd4d70700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00acb40 con 0x7f2fd00cecb0 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fd4d70700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00cbd30 con 0x7f2fd015d380 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fced9d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2fd00cdad0 0x7f2fd006ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37620/0 (socket says 172.21.15.161:37620) 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.482+0000 7f2fced9d700 1 -- 172.21.15.161:0/3222326914 learned_addr learned my addr 172.21.15.161:0/3222326914 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971970069 0 0) 0x7f2fd00cb7d0 con 0x7f2fd00cdad0 2023-08-10T10:29:30.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb80035b0 con 0x7f2fd00cdad0 2023-08-10T10:29:30.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fce59c700 1 --2- 172.21.15.161:0/3222326914 >> v2:172.21.15.175:3300/0 conn(0x7f2fd015d380 0x7f2fd00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 270508580 0 0) 0x7f2fb80035b0 con 0x7f2fd00cdad0 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 >> v2:172.21.15.175:3300/0 conn(0x7f2fd015d380 msgr2=0x7f2fd00ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 --2- 172.21.15.161:0/3222326914 >> v2:172.21.15.175:3300/0 conn(0x7f2fd015d380 0x7f2fd00ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 >> v1:172.21.15.175:6789/0 conn(0x7f2fd00cecb0 legacy=0x7f2fd00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00ce010 con 0x7f2fd00cdad0 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f2fc80019f0 con 0x7f2fd00cdad0 2023-08-10T10:29:30.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 >> v1:172.21.15.161:6789/0 conn(0x7f2fd00cdad0 legacy=0x7f2fd006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00cbd30 con 0x7f2fb8004850 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c1b0 con 0x7f2fb8003a00 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c370 con 0x7f2fb8005210 2023-08-10T10:29:30.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fced9d700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fce59c700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 -- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb8005210 msgr2=0x7f2fb800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 -- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8003a00 msgr2=0x7f2fb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fcdd9b700 1 -- 172.21.15.161:0/3222326914 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80035b0 con 0x7f2fb8004850 2023-08-10T10:29:30.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.483+0000 7f2fced9d700 1 -- 172.21.15.161:0/3222326914 reap_dead start 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00017c0 tx=0x7f2fb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a2ce9b48cb5a52 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00052d0 con 0x7f2fb8004850 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0005430 con 0x7f2fb8004850 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fcd59a700 1 -- 172.21.15.161:0/3222326914 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00038c0 con 0x7f2fb8004850 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 -- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 msgr2=0x7f2fb8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00017c0 tx=0x7f2fb8005880 comp rx=0 tx=0).stop 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 -- 172.21.15.161:0/3222326914 shutdown_connections 2023-08-10T10:29:30.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/3222326914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 -- 172.21.15.161:0/3222326914 >> 172.21.15.161:0/3222326914 conn(0x7f2fd00cf4c0 msgr2=0x7f2fd00cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:30.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 -- 172.21.15.161:0/3222326914 shutdown_connections 2023-08-10T10:29:30.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.484+0000 7f2fd4d70700 1 -- 172.21.15.161:0/3222326914 wait complete. 2023-08-10T10:29:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.486+0000 7f2fd4d70700 1 Processor -- start 2023-08-10T10:29:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.486+0000 7f2fd4d70700 1 -- start start 2023-08-10T10:29:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fd00c75e0 0x7f2fd014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fd00c8d80 0x7f2fd00b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0159d60 con 0x7f2fb8004850 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd014fda0 con 0x7f2fd00c75e0 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fd4d70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00c88f0 con 0x7f2fd00c8d80 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60624/0 (socket says 172.21.15.161:60624) 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 -- 172.21.15.161:0/1201488073 learned_addr learned my addr 172.21.15.161:0/1201488073 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fced9d700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fd00c8d80 0x7f2fd00b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fd00c75e0 0x7f2fd014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 -- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fd00c8d80 msgr2=0x7f2fd00b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fd00c8d80 0x7f2fd00b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 -- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fd00c75e0 msgr2=0x7f2fd014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fd00c75e0 0x7f2fd014f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.487+0000 7f2fce59c700 1 -- 172.21.15.161:0/1201488073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00c7a60 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fce59c700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4011aa0 tx=0x7f2fc4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400f920 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc400faa0 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd00c7ce0 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400fe50 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.488+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd00c82a0 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.489+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00c8bd0 con 0x7f2fb8004850 2023-08-10T10:29:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.489+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fc4014440 con 0x7f2fb8004850 2023-08-10T10:29:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.489+0000 7f2fbeffd700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 0x7f2fb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.490+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fc4089c90 con 0x7f2fb8004850 2023-08-10T10:29:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.490+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 0x7f2fb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.490+0000 7f2fcdd9b700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 0x7f2fb006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00aefb0 tx=0x7f2fc0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.494+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2fc4058940 con 0x7f2fb8004850 2023-08-10T10:29:30.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.681+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fd004ecc0 con 0x7f2fb8004850 2023-08-10T10:29:30.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.682+0000 7f2fbeffd700 1 -- 172.21.15.161:0/1201488073 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fc40584d0 con 0x7f2fb8004850 2023-08-10T10:29:30.683 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:30.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 msgr2=0x7f2fb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 0x7f2fb006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00aefb0 tx=0x7f2fc0009030 comp rx=0 tx=0).stop 2023-08-10T10:29:30.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 msgr2=0x7f2fd0159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4011aa0 tx=0x7f2fc4011e60 comp rx=0 tx=0).stop 2023-08-10T10:29:30.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 shutdown_connections 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2fb006ace0 0x7f2fb006d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fd00c8d80 0x7f2fd00b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fb8004850 0x7f2fd0159ef0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 --2- 172.21.15.161:0/1201488073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fd00c75e0 0x7f2fd014f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 >> 172.21.15.161:0/1201488073 conn(0x7f2fd00cf4c0 msgr2=0x7f2fd00703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 shutdown_connections 2023-08-10T10:29:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.684+0000 7f2fd4d70700 1 -- 172.21.15.161:0/1201488073 wait complete. 2023-08-10T10:29:30.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:30.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.819+0000 7fa82cd93700 1 Processor -- start 2023-08-10T10:29:30.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.819+0000 7fa82cd93700 1 -- start start 2023-08-10T10:29:30.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8280cb9f0 0x7fa8280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa828160d20 0x7fa8280cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa828071950 con 0x7fa8280cb9f0 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280b2660 con 0x7fa828160d20 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82cd93700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280cfb60 con 0x7fa8280cf730 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82659c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8280cb9f0 0x7fa8280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82659c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8280cb9f0 0x7fa8280b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60632/0 (socket says 172.21.15.161:60632) 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa82659c700 1 -- 172.21.15.161:0/2424255568 learned_addr learned my addr 172.21.15.161:0/2424255568 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa825d9b700 1 --2- 172.21.15.161:0/2424255568 >> v2:172.21.15.175:3300/0 conn(0x7fa828160d20 0x7fa8280cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.820+0000 7fa826d9d700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 -- 172.21.15.161:0/2424255568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 msgr2=0x7fa82806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 -- 172.21.15.161:0/2424255568 >> v2:172.21.15.175:3300/0 conn(0x7fa828160d20 msgr2=0x7fa8280cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 --2- 172.21.15.161:0/2424255568 >> v2:172.21.15.175:3300/0 conn(0x7fa828160d20 0x7fa8280cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 -- 172.21.15.161:0/2424255568 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82806dc10 con 0x7fa8280cb9f0 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82659c700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b2120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8280ca2a0 tx=0x7fa81c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb754db4d6af7682 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82559a700 1 -- 172.21.15.161:0/2424255568 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c011830 con 0x7fa8280cb9f0 2023-08-10T10:29:30.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82559a700 1 -- 172.21.15.161:0/2424255568 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c011990 con 0x7fa8280cb9f0 2023-08-10T10:29:30.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82559a700 1 -- 172.21.15.161:0/2424255568 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c011d20 con 0x7fa8280cb9f0 2023-08-10T10:29:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82cd93700 1 -- 172.21.15.161:0/2424255568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8280cb9f0 msgr2=0x7fa8280b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.821+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b2120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8280ca2a0 tx=0x7fa81c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 -- 172.21.15.161:0/2424255568 shutdown_connections 2023-08-10T10:29:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2424255568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b2120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2424255568 >> v2:172.21.15.175:3300/0 conn(0x7fa828160d20 0x7fa8280cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 -- 172.21.15.161:0/2424255568 >> 172.21.15.161:0/2424255568 conn(0x7fa8280cc740 msgr2=0x7fa8280ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 -- 172.21.15.161:0/2424255568 shutdown_connections 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.822+0000 7fa82cd93700 1 -- 172.21.15.161:0/2424255568 wait complete. 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.823+0000 7fa82cd93700 1 Processor -- start 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.823+0000 7fa82cd93700 1 -- start start 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280b31a0 con 0x7fa828160d20 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280b3480 con 0x7fa8280cb9f0 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280b3760 con 0x7fa8280cf730 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60642/0 (socket says 172.21.15.161:60642) 2023-08-10T10:29:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 -- 172.21.15.161:0/2179821505 learned_addr learned my addr 172.21.15.161:0/2179821505 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82659c700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa825d9b700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 -- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 msgr2=0x7fa82815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 -- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 msgr2=0x7fa8280b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 -- 172.21.15.161:0/2179821505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009550 con 0x7fa828160d20 2023-08-10T10:29:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82659c700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa826d9d700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa82000eed0 tx=0x7fa82000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820010040 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000b9f0 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8280b3a40 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.824+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000bda0 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.825+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82815e4e0 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.825+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8280b3f60 con 0x7fa828160d20 2023-08-10T10:29:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.826+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa820014400 con 0x7fa828160d20 2023-08-10T10:29:30.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.826+0000 7fa816ffd700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 0x7fa80806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:30.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.826+0000 7fa82659c700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 0x7fa80806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:30.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.826+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa820089880 con 0x7fa828160d20 2023-08-10T10:29:30.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.827+0000 7fa82659c700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 0x7fa80806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa81c014040 tx=0x7fa81c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:30.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:30.831+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa8280b3f60 con 0x7fa828160d20 2023-08-10T10:29:31.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.015+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8280b3f60 con 0x7fa828160d20 2023-08-10T10:29:31.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.016+0000 7fa816ffd700 1 -- 172.21.15.161:0/2179821505 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8280b3f60 con 0x7fa828160d20 2023-08-10T10:29:31.024 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:31.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 msgr2=0x7fa80806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 0x7fa80806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa81c014040 tx=0x7fa81c008030 comp rx=0 tx=0).stop 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 msgr2=0x7fa8280b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa82000eed0 tx=0x7fa82000ef00 comp rx=0 tx=0).stop 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 shutdown_connections 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa80806ace0 0x7fa80806d1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa828160d20 0x7fa8280b2850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280cb9f0 0x7fa8280b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 --2- 172.21.15.161:0/2179821505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8280cf730 0x7fa82815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 >> 172.21.15.161:0/2179821505 conn(0x7fa8280cc740 msgr2=0x7fa8280ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 shutdown_connections 2023-08-10T10:29:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.018+0000 7fa82cd93700 1 -- 172.21.15.161:0/2179821505 wait complete. 2023-08-10T10:29:31.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:31.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.153+0000 7f94bbb18700 1 Processor -- start 2023-08-10T10:29:31.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.153+0000 7f94bbb18700 1 -- start start 2023-08-10T10:29:31.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94bbb18700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94b40cfa30 0x7f94b40cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94bbb18700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40ce070 con 0x7f94b415e5e0 2023-08-10T10:29:31.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94bbb18700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b415e9c0 con 0x7f94b40cdc40 2023-08-10T10:29:31.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94bbb18700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40cc1c0 con 0x7f94b40cfa30 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b98b4700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f94b415e5e0 0x7f94b40cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37652/0 (socket says 172.21.15.161:37652) 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b98b4700 1 -- 172.21.15.161:0/663099281 learned_addr learned my addr 172.21.15.161:0/663099281 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b90b3700 1 --2- 172.21.15.161:0/663099281 >> v2:172.21.15.175:3300/0 conn(0x7f94b40cfa30 0x7f94b40cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295403774 0 0) 0x7f94b40ce070 con 0x7f94b415e5e0 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a00035b0 con 0x7f94b415e5e0 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582121265 0 0) 0x7f94b415e9c0 con 0x7f94b40cdc40 2023-08-10T10:29:31.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b90b3700 1 -- 172.21.15.161:0/663099281 >> v1:172.21.15.175:6789/0 conn(0x7f94b40cdc40 legacy=0x7f94b40b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b90b3700 1 -- 172.21.15.161:0/663099281 >> v1:172.21.15.161:6789/0 conn(0x7f94b415e5e0 legacy=0x7f94b40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.154+0000 7f94b90b3700 1 -- 172.21.15.161:0/663099281 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40cc4a0 con 0x7f94b40cfa30 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94b90b3700 1 --2- 172.21.15.161:0/663099281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b40cfa30 0x7f94b40cd700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009840 tx=0x7f94a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34312682bceae3b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004230 con 0x7f94b40cfa30 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4004390 con 0x7f94b40cfa30 2023-08-10T10:29:31.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94b88b2700 1 -- 172.21.15.161:0/663099281 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40036a0 con 0x7f94b40cfa30 2023-08-10T10:29:31.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 -- 172.21.15.161:0/663099281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b40cfa30 msgr2=0x7f94b40cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 --2- 172.21.15.161:0/663099281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b40cfa30 0x7f94b40cd700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009840 tx=0x7f94a4009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 -- 172.21.15.161:0/663099281 shutdown_connections 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 --2- 172.21.15.161:0/663099281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b40cfa30 0x7f94b40cd700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 -- 172.21.15.161:0/663099281 >> 172.21.15.161:0/663099281 conn(0x7f94b409a140 msgr2=0x7f94b40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 -- 172.21.15.161:0/663099281 shutdown_connections 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.155+0000 7f94bbb18700 1 -- 172.21.15.161:0/663099281 wait complete. 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.156+0000 7f94bbb18700 1 Processor -- start 2023-08-10T10:29:31.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 -- start start 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 0x7f94b40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 0x7f94b406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c6c30 con 0x7f94b40cfa30 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c6300 con 0x7f94b415e5e0 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94bbb18700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c65e0 con 0x7f94b40cdc40 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94b90b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94b90b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60654/0 (socket says 172.21.15.161:60654) 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.157+0000 7f94b90b3700 1 -- 172.21.15.161:0/3292564981 learned_addr learned my addr 172.21.15.161:0/3292564981 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b98b4700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 0x7f94b40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94ba0b5700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 0x7f94b406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 -- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 msgr2=0x7f94b40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 0x7f94b40ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 -- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 msgr2=0x7f94b406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 0x7f94b406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 -- 172.21.15.161:0/3292564981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40094a0 con 0x7f94b40cfa30 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94ba0b5700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 0x7f94b406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b98b4700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 0x7f94b40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94b90b3700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011630 con 0x7f94b40cfa30 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a401f070 con 0x7f94b40cfa30 2023-08-10T10:29:31.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40119d0 con 0x7f94b40cfa30 2023-08-10T10:29:31.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b40c68c0 con 0x7f94b40cfa30 2023-08-10T10:29:31.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.158+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b40caac0 con 0x7f94b40cfa30 2023-08-10T10:29:31.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.159+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b404ecc0 con 0x7f94b40cfa30 2023-08-10T10:29:31.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.159+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94a4011b30 con 0x7f94b40cfa30 2023-08-10T10:29:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.160+0000 7f94aa7fc700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.160+0000 7f94b98b4700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.160+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94a4021070 con 0x7f94b40cfa30 2023-08-10T10:29:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.160+0000 7f94b98b4700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94b00011e0 tx=0x7f94b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.164+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f94a4055f60 con 0x7f94b40cfa30 2023-08-10T10:29:31.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.353+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94b40c6d70 con 0x7f94b40cfa30 2023-08-10T10:29:31.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.353+0000 7f94aa7fc700 1 -- 172.21.15.161:0/3292564981 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94a402b020 con 0x7f94b40cfa30 2023-08-10T10:29:31.355 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:31.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 msgr2=0x7f949806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94b00011e0 tx=0x7f94b0009040 comp rx=0 tx=0).stop 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 msgr2=0x7f94b415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4004750 comp rx=0 tx=0).stop 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 shutdown_connections 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b415e5e0 0x7f94b406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94b40cdc40 0x7f94b40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 --2- 172.21.15.161:0/3292564981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b40cfa30 0x7f94b415a380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 >> 172.21.15.161:0/3292564981 conn(0x7f94b409a140 msgr2=0x7f94b40d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 shutdown_connections 2023-08-10T10:29:31.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.355+0000 7f94bbb18700 1 -- 172.21.15.161:0/3292564981 wait complete. 2023-08-10T10:29:31.368 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.491+0000 7fed1b9a2700 1 Processor -- start 2023-08-10T10:29:31.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.491+0000 7fed1b9a2700 1 -- start start 2023-08-10T10:29:31.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed1415a3b0 0x7fed140cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 0x7fed140b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed140b2110 con 0x7fed1415a3b0 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1415abb0 con 0x7fed140b1740 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1b9a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1415ae90 con 0x7fed14159fd0 2023-08-10T10:29:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed18f3d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed1415a3b0 0x7fed140cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed18f3d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed1415a3b0 0x7fed140cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60662/0 (socket says 172.21.15.161:60662) 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed18f3d700 1 -- 172.21.15.161:0/2719456078 learned_addr learned my addr 172.21.15.161:0/2719456078 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed1973e700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.492+0000 7fed19f3f700 1 --2- 172.21.15.161:0/2719456078 >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 0x7fed140b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 -- 172.21.15.161:0/2719456078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 msgr2=0x7fed1415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 -- 172.21.15.161:0/2719456078 >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 msgr2=0x7fed140b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 --2- 172.21.15.161:0/2719456078 >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 0x7fed140b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 -- 172.21.15.161:0/2719456078 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1415b170 con 0x7fed1415a3b0 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed19f3f700 1 --2- 172.21.15.161:0/2719456078 >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 0x7fed140b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed18f3d700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed1415a3b0 0x7fed140cdaa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed140af6d0 tx=0x7fed10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6a268fd46df418 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed0bfff700 1 -- 172.21.15.161:0/2719456078 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10011830 con 0x7fed1415a3b0 2023-08-10T10:29:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed0bfff700 1 -- 172.21.15.161:0/2719456078 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10011990 con 0x7fed1415a3b0 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed0bfff700 1 -- 172.21.15.161:0/2719456078 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10011d20 con 0x7fed1415a3b0 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed1b9a2700 1 -- 172.21.15.161:0/2719456078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed1415a3b0 msgr2=0x7fed140cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed1415a3b0 0x7fed140cdaa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed140af6d0 tx=0x7fed10009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed1b9a2700 1 -- 172.21.15.161:0/2719456078 shutdown_connections 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/2719456078 >> v2:172.21.15.175:3300/0 conn(0x7fed140b1740 0x7fed140b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.493+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.494+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/2719456078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed1415a3b0 0x7fed140cdaa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.494+0000 7fed1b9a2700 1 -- 172.21.15.161:0/2719456078 >> 172.21.15.161:0/2719456078 conn(0x7fed140cc740 msgr2=0x7fed140ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.494+0000 7fed1b9a2700 1 -- 172.21.15.161:0/2719456078 shutdown_connections 2023-08-10T10:29:31.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.494+0000 7fed1b9a2700 1 -- 172.21.15.161:0/2719456078 wait complete. 2023-08-10T10:29:31.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 Processor -- start 2023-08-10T10:29:31.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 -- start start 2023-08-10T10:29:31.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1415a3b0 0x7fed140b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c8660 con 0x7fed140b1740 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1415c550 con 0x7fed1415a3b0 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.495+0000 7fed1b9a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c8330 con 0x7fed14159fd0 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60666/0 (socket says 172.21.15.161:60666) 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 -- 172.21.15.161:0/1033049717 learned_addr learned my addr 172.21.15.161:0/1033049717 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:31.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed19f3f700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1415a3b0 0x7fed140b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed18f3d700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 -- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 msgr2=0x7fed1415b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 -- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1415a3b0 msgr2=0x7fed140b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1415a3b0 0x7fed140b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 -- 172.21.15.161:0/1033049717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009550 con 0x7fed140b1740 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1973e700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed0400e9b0 tx=0x7fed0400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04009710 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0400c850 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1415bcb0 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400cbc0 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.496+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1415c270 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.497+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed140c84a0 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.498+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed0400cd20 con 0x7fed140b1740 2023-08-10T10:29:31.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.499+0000 7fed09ffb700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 0x7fecf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.499+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed04089ba0 con 0x7fed140b1740 2023-08-10T10:29:31.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.499+0000 7fed18f3d700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 0x7fecf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.499+0000 7fed18f3d700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 0x7fecf806d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed10009c10 tx=0x7fed10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.502+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed04054c30 con 0x7fed140b1740 2023-08-10T10:29:31.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.691+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed140c84a0 con 0x7fed140b1740 2023-08-10T10:29:31.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.691+0000 7fed09ffb700 1 -- 172.21.15.161:0/1033049717 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed04017020 con 0x7fed140b1740 2023-08-10T10:29:31.693 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:31.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 msgr2=0x7fecf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 0x7fecf806d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed10009c10 tx=0x7fed10008030 comp rx=0 tx=0).stop 2023-08-10T10:29:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 msgr2=0x7fed1414fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed0400e9b0 tx=0x7fed0400ecc0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 shutdown_connections 2023-08-10T10:29:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fecf806ace0 0x7fecf806d1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1415a3b0 0x7fed140b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140b1740 0x7fed1414fcf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 --2- 172.21.15.161:0/1033049717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed14159fd0 0x7fed1415b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 >> 172.21.15.161:0/1033049717 conn(0x7fed140cc740 msgr2=0x7fed14070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 shutdown_connections 2023-08-10T10:29:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.694+0000 7fed1b9a2700 1 -- 172.21.15.161:0/1033049717 wait complete. 2023-08-10T10:29:31.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:31.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.826+0000 7f0df9e89700 1 Processor -- start 2023-08-10T10:29:31.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.826+0000 7f0df9e89700 1 -- start start 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0df9e89700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0df4154620 0x7f0df40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0df9e89700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415b290 con 0x7f0df4071d10 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0df9e89700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415b570 con 0x7f0df406e650 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0df9e89700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40c5890 con 0x7f0df4154620 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0df37fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0df4154620 0x7f0df40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0debfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0df4071d10 0x7f0df406df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37680/0 (socket says 172.21.15.161:37680) 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.827+0000 7f0debfff700 1 -- 172.21.15.161:0/3500450945 learned_addr learned my addr 172.21.15.161:0/3500450945 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df37fe700 1 -- 172.21.15.161:0/3500450945 >> v1:172.21.15.175:6789/0 conn(0x7f0df406e650 legacy=0x7f0df415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df37fe700 1 -- 172.21.15.161:0/3500450945 >> v1:172.21.15.161:6789/0 conn(0x7f0df4071d10 legacy=0x7f0df406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df2ffd700 1 -- 172.21.15.161:0/3500450945 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268077350 0 0) 0x7f0df415b290 con 0x7f0df4071d10 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df37fe700 1 -- 172.21.15.161:0/3500450945 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4070cf0 con 0x7f0df4154620 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df37fe700 1 --2- 172.21.15.161:0/3500450945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4154620 0x7f0df40717d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009840 tx=0x7f0de4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c11bf8d3259690 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df2ffd700 1 -- 172.21.15.161:0/3500450945 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4011830 con 0x7f0df4154620 2023-08-10T10:29:31.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df2ffd700 1 -- 172.21.15.161:0/3500450945 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4011990 con 0x7f0df4154620 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.828+0000 7f0df2ffd700 1 -- 172.21.15.161:0/3500450945 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4011d20 con 0x7f0df4154620 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 -- 172.21.15.161:0/3500450945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4154620 msgr2=0x7f0df40717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 --2- 172.21.15.161:0/3500450945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4154620 0x7f0df40717d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009840 tx=0x7f0de4009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 -- 172.21.15.161:0/3500450945 shutdown_connections 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 --2- 172.21.15.161:0/3500450945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4154620 0x7f0df40717d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 -- 172.21.15.161:0/3500450945 >> 172.21.15.161:0/3500450945 conn(0x7f0df40cfd70 msgr2=0x7f0df40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:31.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 -- 172.21.15.161:0/3500450945 shutdown_connections 2023-08-10T10:29:31.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.829+0000 7f0df9e89700 1 -- 172.21.15.161:0/3500450945 wait complete. 2023-08-10T10:29:31.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.830+0000 7f0df9e89700 1 Processor -- start 2023-08-10T10:29:31.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.830+0000 7f0df9e89700 1 -- start start 2023-08-10T10:29:31.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 0x7f0df41517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 0x7f0df414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41500a0 con 0x7f0df406e650 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4138970 con 0x7f0df4071d10 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df9e89700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41ee5a0 con 0x7f0df41382d0 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60680/0 (socket says 172.21.15.161:60680) 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.831+0000 7f0df37fe700 1 -- 172.21.15.161:0/1745850503 learned_addr learned my addr 172.21.15.161:0/1745850503 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:31.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0debfff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 0x7f0df41517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df3fff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 0x7f0df414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 -- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 msgr2=0x7f0df414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 0x7f0df414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 -- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 msgr2=0x7f0df41517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 0x7f0df41517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 -- 172.21.15.161:0/1745850503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40094a0 con 0x7f0df406e650 2023-08-10T10:29:31.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df3fff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 0x7f0df414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0debfff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 0x7f0df41517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df37fe700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0de40090b0 tx=0x7f0de4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de401a900 con 0x7f0df406e650 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de401aa60 con 0x7f0df406e650 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df414fae0 con 0x7f0df406e650 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de401add0 con 0x7f0df406e650 2023-08-10T10:29:31.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.832+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df4138c10 con 0x7f0df406e650 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.833+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df41387d0 con 0x7f0df406e650 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.833+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0de4022070 con 0x7f0df406e650 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.834+0000 7f0df0ff9700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 0x7f0dd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.834+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0de408a730 con 0x7f0df406e650 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.834+0000 7f0debfff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 0x7f0dd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:31.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.834+0000 7f0debfff700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 0x7f0dd406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0df41f1c20 tx=0x7f0ddc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:31.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:31.838+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0df41387d0 con 0x7f0df406e650 2023-08-10T10:29:32.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.025+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0df41387d0 con 0x7f0df406e650 2023-08-10T10:29:32.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.026+0000 7f0df0ff9700 1 -- 172.21.15.161:0/1745850503 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0df41387d0 con 0x7f0df406e650 2023-08-10T10:29:32.028 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:32.028 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:32.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 msgr2=0x7f0dd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 0x7f0dd406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0df41f1c20 tx=0x7f0ddc009040 comp rx=0 tx=0).stop 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 msgr2=0x7f0df4151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0de40090b0 tx=0x7f0de4004750 comp rx=0 tx=0).stop 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 shutdown_connections 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0dd406ace0 0x7f0dd406d1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df41382d0 0x7f0df414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df406e650 0x7f0df4151290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 --2- 172.21.15.161:0/1745850503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df4071d10 0x7f0df41517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.028+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 >> 172.21.15.161:0/1745850503 conn(0x7f0df40cfd70 msgr2=0x7f0df41535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.029+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 shutdown_connections 2023-08-10T10:29:32.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.029+0000 7f0df9e89700 1 -- 172.21.15.161:0/1745850503 wait complete. 2023-08-10T10:29:32.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:32.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:32.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.165+0000 7fb78df45700 1 Processor -- start 2023-08-10T10:29:32.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.165+0000 7fb78df45700 1 -- start start 2023-08-10T10:29:32.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb78df45700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb78815e5e0 0x7fb7880cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb78df45700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78815e9c0 con 0x7fb7880cde10 2023-08-10T10:29:32.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb78df45700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880cc1c0 con 0x7fb7880cb920 2023-08-10T10:29:32.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb78df45700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880cc4a0 con 0x7fb78815e5e0 2023-08-10T10:29:32.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb787fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb7880cde10 0x7fb7880b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37696/0 (socket says 172.21.15.161:37696) 2023-08-10T10:29:32.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb787fff700 1 -- 172.21.15.161:0/3814551890 learned_addr learned my addr 172.21.15.161:0/3814551890 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:32.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794368360 0 0) 0x7fb78815e9c0 con 0x7fb7880cde10 2023-08-10T10:29:32.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7700035b0 con 0x7fb7880cde10 2023-08-10T10:29:32.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7877fe700 1 --2- 172.21.15.161:0/3814551890 >> v2:172.21.15.175:3300/0 conn(0x7fb78815e5e0 0x7fb7880cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570564045 0 0) 0x7fb7700035b0 con 0x7fb7880cde10 2023-08-10T10:29:32.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 >> v2:172.21.15.175:3300/0 conn(0x7fb78815e5e0 msgr2=0x7fb7880cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 --2- 172.21.15.161:0/3814551890 >> v2:172.21.15.175:3300/0 conn(0x7fb78815e5e0 0x7fb7880cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 >> v1:172.21.15.175:6789/0 conn(0x7fb7880cb920 legacy=0x7fb7880cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880cc780 con 0x7fb7880cde10 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fb7800019f0 con 0x7fb7880cde10 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7877fe700 1 --2- 172.21.15.161:0/3814551890 >> v2:172.21.15.175:3300/0 conn(0x7fb78815e5e0 0x7fb7880cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 >> v1:172.21.15.161:6789/0 conn(0x7fb7880cde10 legacy=0x7fb7880b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770003a00 0x7fb770003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb770004850 0x7fb770004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 0x7fb77000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880cc4a0 con 0x7fb770005210 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77000c160 con 0x7fb770003a00 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77000c320 con 0x7fb770004850 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.166+0000 7fb787fff700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 0x7fb77000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb7877fe700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770003a00 0x7fb770003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb786ffd700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb770004850 0x7fb770004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 -- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb770004850 msgr2=0x7fb770004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb770004850 0x7fb770004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 -- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770003a00 msgr2=0x7fb770003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770003a00 0x7fb770003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 -- 172.21.15.161:0/3814551890 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700035b0 con 0x7fb770005210 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 -- 172.21.15.161:0/3814551890 reap_dead start 2023-08-10T10:29:32.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb787fff700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 0x7fb77000ba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb78000a830 tx=0x7fb770005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7556705926eeea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000a2f0 con 0x7fb770005210 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780012620 con 0x7fb770005210 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb7867fc700 1 -- 172.21.15.161:0/3814551890 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800129d0 con 0x7fb770005210 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb78df45700 1 -- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 msgr2=0x7fb77000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb78df45700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 0x7fb77000ba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb78000a830 tx=0x7fb770005880 comp rx=0 tx=0).stop 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.167+0000 7fb78df45700 1 -- 172.21.15.161:0/3814551890 shutdown_connections 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.168+0000 7fb78df45700 1 --2- 172.21.15.161:0/3814551890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb770005210 0x7fb77000ba10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.168+0000 7fb78df45700 1 -- 172.21.15.161:0/3814551890 >> 172.21.15.161:0/3814551890 conn(0x7fb78809a140 msgr2=0x7fb7880d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.168+0000 7fb78df45700 1 -- 172.21.15.161:0/3814551890 shutdown_connections 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.168+0000 7fb78df45700 1 -- 172.21.15.161:0/3814551890 wait complete. 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.169+0000 7fb78df45700 1 Processor -- start 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.169+0000 7fb78df45700 1 -- start start 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770005210 0x7fb7881f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7880c8f70 0x7fb7880c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c9cc0 con 0x7fb7880b5d40 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c9fa0 con 0x7fb770005210 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880ca280 con 0x7fb7880c8f70 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60700/0 (socket says 172.21.15.161:60700) 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 -- 172.21.15.161:0/1157586279 learned_addr learned my addr 172.21.15.161:0/1157586279 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb7877fe700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770005210 0x7fb7881f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb787fff700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7880c8f70 0x7fb7880c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 -- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7880c8f70 msgr2=0x7fb7880c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7880c8f70 0x7fb7880c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 -- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770005210 msgr2=0x7fb7881f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770005210 0x7fb7881f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 -- 172.21.15.161:0/1157586279 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880ca560 con 0x7fb7880b5d40 2023-08-10T10:29:32.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb786ffd700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00f820 tx=0x7fb77c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0052e0 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880b6700 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c005440 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0038a0 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.170+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880b3990 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.171+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78804ecc0 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.172+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb77c003a00 con 0x7fb7880b5d40 2023-08-10T10:29:32.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.172+0000 7fb76ffff700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 0x7fb77406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.172+0000 7fb7877fe700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 0x7fb77406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.172+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb77c0890d0 con 0x7fb7880b5d40 2023-08-10T10:29:32.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.173+0000 7fb7877fe700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 0x7fb77406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb778004520 tx=0x7fb778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.177+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb77c054190 con 0x7fb7880b5d40 2023-08-10T10:29:32.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.365+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7880af5f0 con 0x7fb7880b5d40 2023-08-10T10:29:32.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.366+0000 7fb76ffff700 1 -- 172.21.15.161:0/1157586279 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb77c003cb0 con 0x7fb7880b5d40 2023-08-10T10:29:32.368 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:32.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 msgr2=0x7fb77406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 0x7fb77406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb778004520 tx=0x7fb778008040 comp rx=0 tx=0).stop 2023-08-10T10:29:32.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 msgr2=0x7fb7880b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00f820 tx=0x7fb77c00fb30 comp rx=0 tx=0).stop 2023-08-10T10:29:32.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 shutdown_connections 2023-08-10T10:29:32.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb77406ace0 0x7fb77406d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7880c8f70 0x7fb7880c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb770005210 0x7fb7881f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 --2- 172.21.15.161:0/1157586279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7880b5d40 0x7fb7880b61c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 >> 172.21.15.161:0/1157586279 conn(0x7fb78809a140 msgr2=0x7fb78815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 shutdown_connections 2023-08-10T10:29:32.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.368+0000 7fb78df45700 1 -- 172.21.15.161:0/1157586279 wait complete. 2023-08-10T10:29:32.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:32.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:32.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:32.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.511+0000 7f897c59c700 1 Processor -- start 2023-08-10T10:29:32.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.511+0000 7f897c59c700 1 -- start start 2023-08-10T10:29:32.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89740cb9f0 0x7f89740b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8974160d20 0x7f89740cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 0x7f897406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8974071950 con 0x7f8974160d20 2023-08-10T10:29:32.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89740cfb80 con 0x7f89740cf730 2023-08-10T10:29:32.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897c59c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b2660 con 0x7f89740cb9f0 2023-08-10T10:29:32.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f8979b37700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8974160d20 0x7f89740cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f8979b37700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8974160d20 0x7f89740cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60706/0 (socket says 172.21.15.161:60706) 2023-08-10T10:29:32.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f8979b37700 1 -- 172.21.15.161:0/3872418801 learned_addr learned my addr 172.21.15.161:0/3872418801 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:32.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897ab39700 1 --2- 172.21.15.161:0/3872418801 >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 0x7f897406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.512+0000 7f897a338700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89740cb9f0 0x7f89740b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 -- 172.21.15.161:0/3872418801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89740cb9f0 msgr2=0x7f89740b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89740cb9f0 0x7f89740b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 -- 172.21.15.161:0/3872418801 >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 msgr2=0x7f897406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 --2- 172.21.15.161:0/3872418801 >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 0x7f897406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 -- 172.21.15.161:0/3872418801 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897406dc10 con 0x7f8974160d20 2023-08-10T10:29:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f897ab39700 1 --2- 172.21.15.161:0/3872418801 >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 0x7f897406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:32.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979b37700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8974160d20 0x7f89740cf1f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8974070620 tx=0x7f8964009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90819f201a2171f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979336700 1 -- 172.21.15.161:0/3872418801 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400b870 con 0x7f8974160d20 2023-08-10T10:29:32.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979336700 1 -- 172.21.15.161:0/3872418801 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400b9d0 con 0x7f8974160d20 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f8979336700 1 -- 172.21.15.161:0/3872418801 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400bd60 con 0x7f8974160d20 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f897c59c700 1 -- 172.21.15.161:0/3872418801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8974160d20 msgr2=0x7f89740cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.513+0000 7f897c59c700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8974160d20 0x7f89740cf1f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8974070620 tx=0x7f8964009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 -- 172.21.15.161:0/3872418801 shutdown_connections 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 --2- 172.21.15.161:0/3872418801 >> v2:172.21.15.175:3300/0 conn(0x7f89740cf730 0x7f897406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89740cb9f0 0x7f89740b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 --2- 172.21.15.161:0/3872418801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8974160d20 0x7f89740cf1f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 -- 172.21.15.161:0/3872418801 >> 172.21.15.161:0/3872418801 conn(0x7f89740cc740 msgr2=0x7f89740ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 -- 172.21.15.161:0/3872418801 shutdown_connections 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.514+0000 7f897c59c700 1 -- 172.21.15.161:0/3872418801 wait complete. 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.515+0000 7f897c59c700 1 Processor -- start 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.515+0000 7f897c59c700 1 -- start start 2023-08-10T10:29:32.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.515+0000 7f897c59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.515+0000 7f897c59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89740cf730 0x7f89741e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 0x7f89740b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897414a3c0 con 0x7f89740cb9f0 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8974159520 con 0x7f89740cf730 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b1d50 con 0x7f8974160d20 2023-08-10T10:29:32.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60712/0 (socket says 172.21.15.161:60712) 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 -- 172.21.15.161:0/3204154523 learned_addr learned my addr 172.21.15.161:0/3204154523 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f8979b37700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89740cf730 0x7f89741e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897ab39700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 0x7f89740b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 -- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 msgr2=0x7f89740b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 0x7f89740b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 -- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89740cf730 msgr2=0x7f89741e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89740cf730 0x7f89741e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 -- 172.21.15.161:0/3204154523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964009550 con 0x7f89740cb9f0 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897ab39700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 0x7f89740b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897a338700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f896c007e60 tx=0x7f896c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c00ede0 con 0x7f89740cb9f0 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c014420 con 0x7f89740cb9f0 2023-08-10T10:29:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8974149d70 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0147b0 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.516+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740b2030 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.517+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8974160b10 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.518+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f896c014910 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.518+0000 7f896affd700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 0x7f895806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.518+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f896c089b00 con 0x7f89740cb9f0 2023-08-10T10:29:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.518+0000 7f8979b37700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 0x7f895806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.519+0000 7f8979b37700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 0x7f895806d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8964009c10 tx=0x7f896401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.523+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8974160b10 con 0x7f89740cb9f0 2023-08-10T10:29:32.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.711+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8974160b10 con 0x7f89740cb9f0 2023-08-10T10:29:32.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.711+0000 7f896affd700 1 -- 172.21.15.161:0/3204154523 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8974160b10 con 0x7f89740cb9f0 2023-08-10T10:29:32.713 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:32.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 msgr2=0x7f895806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 0x7f895806d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8964009c10 tx=0x7f896401d040 comp rx=0 tx=0).stop 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 msgr2=0x7f897414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f896c007e60 tx=0x7f896c00e3c0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 shutdown_connections 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f895806ace0 0x7f895806d1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8974160d20 0x7f89740b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89740cb9f0 0x7f897414a850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 --2- 172.21.15.161:0/3204154523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89740cf730 0x7f89741e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 >> 172.21.15.161:0/3204154523 conn(0x7f89740cc740 msgr2=0x7f89740ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 shutdown_connections 2023-08-10T10:29:32.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.713+0000 7f897c59c700 1 -- 172.21.15.161:0/3204154523 wait complete. 2023-08-10T10:29:32.727 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:32.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.848+0000 7fd0215f4700 1 Processor -- start 2023-08-10T10:29:32.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.848+0000 7fd0215f4700 1 -- start start 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd0215f4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd0215f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 0x7fd01c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd0215f4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c15abb0 con 0x7fd01c159fd0 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd0215f4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0b20f0 con 0x7fd01c15e4f0 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd0215f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c15ae90 con 0x7fd01c0b1740 2023-08-10T10:29:32.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 0x7fd01c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59522/0 (socket says 172.21.15.161:59522) 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 -- 172.21.15.161:0/1116388537 learned_addr learned my addr 172.21.15.161:0/1116388537 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01affd700 1 --1- 172.21.15.161:0/1116388537 >> v1:172.21.15.175:6789/0 conn(0x7fd01c159fd0 0x7fd01c15a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39518/0 (socket says 172.21.15.161:39518) 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 -- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 msgr2=0x7fd01c0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 0x7fd01c0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 -- 172.21.15.161:0/1116388537 >> v1:172.21.15.175:6789/0 conn(0x7fd01c159fd0 legacy=0x7fd01c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01a7fc700 1 -- 172.21.15.161:0/1116388537 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c15b170 con 0x7fd01c15e4f0 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd019ffb700 1 -- 172.21.15.161:0/1116388537 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150825076 0 0) 0x7fd01c15abb0 con 0x7fd01c159fd0 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.849+0000 7fd01b7fe700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 0x7fd01c0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd01a7fc700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0098f0 tx=0x7fd00c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a121a2b1c9fc8e47 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd019ffb700 1 -- 172.21.15.161:0/1116388537 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c011830 con 0x7fd01c15e4f0 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd019ffb700 1 -- 172.21.15.161:0/1116388537 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c011990 con 0x7fd01c15e4f0 2023-08-10T10:29:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd019ffb700 1 -- 172.21.15.161:0/1116388537 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c011d20 con 0x7fd01c15e4f0 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 -- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c15e4f0 msgr2=0x7fd01c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0098f0 tx=0x7fd00c009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 -- 172.21.15.161:0/1116388537 shutdown_connections 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c0b1740 0x7fd01c0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1116388537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c15e4f0 0x7fd01c0cdaa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 -- 172.21.15.161:0/1116388537 >> 172.21.15.161:0/1116388537 conn(0x7fd01c0cc740 msgr2=0x7fd01c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 -- 172.21.15.161:0/1116388537 shutdown_connections 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.850+0000 7fd0215f4700 1 -- 172.21.15.161:0/1116388537 wait complete. 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 Processor -- start 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 -- start start 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c0b1740 0x7fd01c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c159fd0 0x7fd01c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b3bf0 con 0x7fd01c15e4f0 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0c7770 con 0x7fd01c0b1740 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd0215f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0c7a50 con 0x7fd01c159fd0 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.852+0000 7fd01b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60730/0 (socket says 172.21.15.161:60730) 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 -- 172.21.15.161:0/1896374587 learned_addr learned my addr 172.21.15.161:0/1896374587 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01affd700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c0b1740 0x7fd01c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01a7fc700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c159fd0 0x7fd01c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 -- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c159fd0 msgr2=0x7fd01c0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c159fd0 0x7fd01c0c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 -- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c0b1740 msgr2=0x7fd01c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c0b1740 0x7fd01c1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 -- 172.21.15.161:0/1896374587 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009a70 con 0x7fd01c15e4f0 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd01b7fe700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd01400efc0 tx=0x7fd01400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400ca90 con 0x7fd01c15e4f0 2023-08-10T10:29:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01400f040 con 0x7fd01c15e4f0 2023-08-10T10:29:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c009550 con 0x7fd01c15e4f0 2023-08-10T10:29:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400ce10 con 0x7fd01c15e4f0 2023-08-10T10:29:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.853+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c0c8010 con 0x7fd01c15e4f0 2023-08-10T10:29:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.854+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c0b39c0 con 0x7fd01c15e4f0 2023-08-10T10:29:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.855+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd014014480 con 0x7fd01c15e4f0 2023-08-10T10:29:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.855+0000 7fd0037fe700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 0x7fd00806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.855+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd014089a40 con 0x7fd01c15e4f0 2023-08-10T10:29:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.855+0000 7fd01affd700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 0x7fd00806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.856+0000 7fd01affd700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 0x7fd00806d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd010007fd0 tx=0x7fd010007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:32.859+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd01c0b39c0 con 0x7fd01c15e4f0 2023-08-10T10:29:33.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.045+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd01c0b39c0 con 0x7fd01c15e4f0 2023-08-10T10:29:33.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.046+0000 7fd0037fe700 1 -- 172.21.15.161:0/1896374587 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd01c0b39c0 con 0x7fd01c15e4f0 2023-08-10T10:29:33.047 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:33.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 msgr2=0x7fd00806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 0x7fd00806d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd010007fd0 tx=0x7fd010007de0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 msgr2=0x7fd01c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd01400efc0 tx=0x7fd01400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 shutdown_connections 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd00806ace0 0x7fd00806d1a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd01c15e4f0 0x7fd01c06a190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd01c0b1740 0x7fd01c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 --2- 172.21.15.161:0/1896374587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd01c159fd0 0x7fd01c0c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 >> 172.21.15.161:0/1896374587 conn(0x7fd01c0cc740 msgr2=0x7fd01c15a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 shutdown_connections 2023-08-10T10:29:33.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.048+0000 7fd0215f4700 1 -- 172.21.15.161:0/1896374587 wait complete. 2023-08-10T10:29:33.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:33.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.184+0000 7fc87eee7700 1 Processor -- start 2023-08-10T10:29:33.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.184+0000 7fc87eee7700 1 -- start start 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8781609d0 0x7fc8780d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc8780d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8780d1b60 0x7fc878160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780b22f0 con 0x7fc8781609d0 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780d1ff0 con 0x7fc8780d1b60 2023-08-10T10:29:33.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87eee7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878160db0 con 0x7fc8780d0ed0 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87cc83700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8781609d0 0x7fc8780d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87cc83700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8781609d0 0x7fc8780d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60734/0 (socket says 172.21.15.161:60734) 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.185+0000 7fc87cc83700 1 -- 172.21.15.161:0/2713700727 learned_addr learned my addr 172.21.15.161:0/2713700727 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87d484700 1 --2- 172.21.15.161:0/2713700727 >> v2:172.21.15.175:3300/0 conn(0x7fc8780d1b60 0x7fc878160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc877fff700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc8780d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 -- 172.21.15.161:0/2713700727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 msgr2=0x7fc8780d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc8780d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 -- 172.21.15.161:0/2713700727 >> v2:172.21.15.175:3300/0 conn(0x7fc8780d1b60 msgr2=0x7fc878160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 --2- 172.21.15.161:0/2713700727 >> v2:172.21.15.175:3300/0 conn(0x7fc8780d1b60 0x7fc878160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 -- 172.21.15.161:0/2713700727 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780cddf0 con 0x7fc8781609d0 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87cc83700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780d3b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc87808c770 tx=0x7fc86c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8fa81104890fed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc8777fe700 1 -- 172.21.15.161:0/2713700727 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00b870 con 0x7fc8781609d0 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc8777fe700 1 -- 172.21.15.161:0/2713700727 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00b9d0 con 0x7fc8781609d0 2023-08-10T10:29:33.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc8777fe700 1 -- 172.21.15.161:0/2713700727 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00bd60 con 0x7fc8781609d0 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87eee7700 1 -- 172.21.15.161:0/2713700727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 msgr2=0x7fc8780d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.186+0000 7fc87eee7700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780d3b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc87808c770 tx=0x7fc86c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 -- 172.21.15.161:0/2713700727 shutdown_connections 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 --2- 172.21.15.161:0/2713700727 >> v2:172.21.15.175:3300/0 conn(0x7fc8780d1b60 0x7fc878160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780d3b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 --2- 172.21.15.161:0/2713700727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc8780d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 -- 172.21.15.161:0/2713700727 >> 172.21.15.161:0/2713700727 conn(0x7fc8780d3040 msgr2=0x7fc8780d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 -- 172.21.15.161:0/2713700727 shutdown_connections 2023-08-10T10:29:33.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.187+0000 7fc87eee7700 1 -- 172.21.15.161:0/2713700727 wait complete. 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.188+0000 7fc87eee7700 1 Processor -- start 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.188+0000 7fc87eee7700 1 -- start start 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc878142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8780d1b60 0x7fc8781f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878160090 con 0x7fc8781609d0 2023-08-10T10:29:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878159290 con 0x7fc8780d1b60 2023-08-10T10:29:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87eee7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781f6ed0 con 0x7fc8780d0ed0 2023-08-10T10:29:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87d484700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87d484700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60744/0 (socket says 172.21.15.161:60744) 2023-08-10T10:29:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87d484700 1 -- 172.21.15.161:0/3504905854 learned_addr learned my addr 172.21.15.161:0/3504905854 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc877fff700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8780d1b60 0x7fc8781f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.189+0000 7fc87cc83700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc878142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 -- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 msgr2=0x7fc878142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc878142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 -- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8780d1b60 msgr2=0x7fc8781f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8780d1b60 0x7fc8781f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 -- 172.21.15.161:0/3504905854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c009550 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87d484700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc870007e70 tx=0x7fc87000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000ed30 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000eeb0 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc878145f80 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870014640 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.190+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8781454b0 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.191+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87804ecc0 con 0x7fc8781609d0 2023-08-10T10:29:33.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.191+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8700147a0 con 0x7fc8781609d0 2023-08-10T10:29:33.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.192+0000 7fc8757fa700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 0x7fc85c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.192+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc870089b90 con 0x7fc8781609d0 2023-08-10T10:29:33.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.192+0000 7fc87cc83700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 0x7fc85c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.192+0000 7fc87cc83700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 0x7fc85c06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000c00 tx=0x7fc86c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.196+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc8700586d0 con 0x7fc8781609d0 2023-08-10T10:29:33.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.384+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8781593d0 con 0x7fc8781609d0 2023-08-10T10:29:33.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.384+0000 7fc8757fa700 1 -- 172.21.15.161:0/3504905854 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc870058260 con 0x7fc8781609d0 2023-08-10T10:29:33.385 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:33.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 msgr2=0x7fc85c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 0x7fc85c06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000c00 tx=0x7fc86c008030 comp rx=0 tx=0).stop 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 msgr2=0x7fc8780b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc870007e70 tx=0x7fc87000e3c0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 shutdown_connections 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc85c06ace0 0x7fc85c06d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8781609d0 0x7fc8780b0c50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8780d0ed0 0x7fc878142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 --2- 172.21.15.161:0/3504905854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8780d1b60 0x7fc8781f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 >> 172.21.15.161:0/3504905854 conn(0x7fc8780d3040 msgr2=0x7fc8780cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 shutdown_connections 2023-08-10T10:29:33.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.386+0000 7fc87eee7700 1 -- 172.21.15.161:0/3504905854 wait complete. 2023-08-10T10:29:33.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:33.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.521+0000 7fd04a3b8700 1 Processor -- start 2023-08-10T10:29:33.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.521+0000 7fd04a3b8700 1 -- start start 2023-08-10T10:29:33.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd04a3b8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd04406df40 0x7fd04406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd04a3b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04415a5c0 0x7fd04415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd04a3b8700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd044071ee0 con 0x7fd044154620 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd04a3b8700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440c5890 con 0x7fd04406df40 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd04a3b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04406e910 con 0x7fd04415a5c0 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd04406df40 0x7fd04406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd043fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd044154620 0x7fd0440717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37754/0 (socket says 172.21.15.161:37754) 2023-08-10T10:29:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd04406df40 0x7fd04406e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60750/0 (socket says 172.21.15.161:60750) 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd043fff700 1 -- 172.21.15.161:0/163369554 learned_addr learned my addr 172.21.15.161:0/163369554 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd048955700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04415a5c0 0x7fd04415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 -- 172.21.15.161:0/163369554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04415a5c0 msgr2=0x7fd04415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04415a5c0 0x7fd04415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 -- 172.21.15.161:0/163369554 >> v1:172.21.15.161:6789/0 conn(0x7fd044154620 legacy=0x7fd0440717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd042ffd700 1 -- 172.21.15.161:0/163369554 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894082888 0 0) 0x7fd044071ee0 con 0x7fd044154620 2023-08-10T10:29:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 -- 172.21.15.161:0/163369554 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04415b290 con 0x7fd04406df40 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd0437fe700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04406df40 0x7fd04406e3d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd038009840 tx=0x7fd038009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fac1a66d97a6f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.522+0000 7fd042ffd700 1 -- 172.21.15.161:0/163369554 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038011830 con 0x7fd04406df40 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd042ffd700 1 -- 172.21.15.161:0/163369554 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038011990 con 0x7fd04406df40 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd042ffd700 1 -- 172.21.15.161:0/163369554 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038011d20 con 0x7fd04406df40 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 -- 172.21.15.161:0/163369554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04406df40 msgr2=0x7fd04406e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04406df40 0x7fd04406e3d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd038009840 tx=0x7fd038009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 -- 172.21.15.161:0/163369554 shutdown_connections 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04415a5c0 0x7fd04415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/163369554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04406df40 0x7fd04406e3d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 -- 172.21.15.161:0/163369554 >> 172.21.15.161:0/163369554 conn(0x7fd0440cfd70 msgr2=0x7fd0440d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 -- 172.21.15.161:0/163369554 shutdown_connections 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.523+0000 7fd04a3b8700 1 -- 172.21.15.161:0/163369554 wait complete. 2023-08-10T10:29:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.524+0000 7fd04a3b8700 1 Processor -- start 2023-08-10T10:29:33.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.524+0000 7fd04a3b8700 1 -- start start 2023-08-10T10:29:33.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04406df40 0x7fd044155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd044154620 0x7fd04406a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440b31e0 con 0x7fd04415a5c0 2023-08-10T10:29:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044155d10 con 0x7fd044154620 2023-08-10T10:29:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd04a3b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440b28b0 con 0x7fd04406df40 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd048955700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd048955700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60756/0 (socket says 172.21.15.161:60756) 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.525+0000 7fd048955700 1 -- 172.21.15.161:0/4146738658 learned_addr learned my addr 172.21.15.161:0/4146738658 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd043fff700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04406df40 0x7fd044155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd0437fe700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd044154620 0x7fd04406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 -- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04406df40 msgr2=0x7fd044155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04406df40 0x7fd044155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 -- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd044154620 msgr2=0x7fd04406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd044154620 0x7fd04406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 -- 172.21.15.161:0/4146738658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380094a0 con 0x7fd04415a5c0 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd048955700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00cc30 tx=0x7fd03c00a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00ab70 con 0x7fd04415a5c0 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00acd0 con 0x7fd04415a5c0 2023-08-10T10:29:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c003c40 con 0x7fd04415a5c0 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0440b2b90 con 0x7fd04415a5c0 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.526+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0440b3670 con 0x7fd04415a5c0 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.527+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0441e4840 con 0x7fd04415a5c0 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.527+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd03c00f3f0 con 0x7fd04415a5c0 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.528+0000 7fd040ff9700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 0x7fd03006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.528+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd03c089660 con 0x7fd04415a5c0 2023-08-10T10:29:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.528+0000 7fd043fff700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 0x7fd03006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.528+0000 7fd043fff700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 0x7fd03006d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd034000f60 tx=0x7fd034007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.532+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd03c054710 con 0x7fd04415a5c0 2023-08-10T10:29:33.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.721+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0440744e0 con 0x7fd04415a5c0 2023-08-10T10:29:33.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.722+0000 7fd040ff9700 1 -- 172.21.15.161:0/4146738658 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd03c057d30 con 0x7fd04415a5c0 2023-08-10T10:29:33.723 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:33.724 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:33.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 msgr2=0x7fd03006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 0x7fd03006d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd034000f60 tx=0x7fd034007be0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 msgr2=0x7fd04406a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00cc30 tx=0x7fd03c00a1f0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 shutdown_connections 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd03006ace0 0x7fd03006d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd04415a5c0 0x7fd04406a6d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04406df40 0x7fd044155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 --2- 172.21.15.161:0/4146738658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd044154620 0x7fd04406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 >> 172.21.15.161:0/4146738658 conn(0x7fd0440cfd70 msgr2=0x7fd044071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 shutdown_connections 2023-08-10T10:29:33.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.724+0000 7fd04a3b8700 1 -- 172.21.15.161:0/4146738658 wait complete. 2023-08-10T10:29:33.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:33.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:33.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.862+0000 7fb1de3c6700 1 Processor -- start 2023-08-10T10:29:33.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.862+0000 7fb1de3c6700 1 -- start start 2023-08-10T10:29:33.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1de3c6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1d815d380 0x7fb1d80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1de3c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 0x7fb1d806ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1de3c6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80cb7d0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1de3c6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80cbd30 con 0x7fb1d815d380 2023-08-10T10:29:33.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1de3c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80cf130 con 0x7fb1d80cdad0 2023-08-10T10:29:33.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1d815d380 0x7fb1d80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1d815d380 0x7fb1d80ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60760/0 (socket says 172.21.15.161:60760) 2023-08-10T10:29:33.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 -- 172.21.15.161:0/3673164787 learned_addr learned my addr 172.21.15.161:0/3673164787 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:33.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1dc963700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 0x7fb1d806ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 -- 172.21.15.161:0/3673164787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 msgr2=0x7fb1d806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:33.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 0x7fb1d806ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 -- 172.21.15.161:0/3673164787 >> v1:172.21.15.175:6789/0 conn(0x7fb1d80cecb0 legacy=0x7fb1d80cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1d7fff700 1 -- 172.21.15.161:0/3673164787 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80acb40 con 0x7fb1d815d380 2023-08-10T10:29:33.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.863+0000 7fb1dc963700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 0x7fb1d806ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:33.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1d7fff700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d815d380 0x7fb1d80ce770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0098f0 tx=0x7fb1cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef19fe4feaaa3a85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1d6ffd700 1 -- 172.21.15.161:0/3673164787 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00b8a0 con 0x7fb1d815d380 2023-08-10T10:29:33.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1d6ffd700 1 -- 172.21.15.161:0/3673164787 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00ba00 con 0x7fb1d815d380 2023-08-10T10:29:33.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1d6ffd700 1 -- 172.21.15.161:0/3673164787 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00bd90 con 0x7fb1d815d380 2023-08-10T10:29:33.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 -- 172.21.15.161:0/3673164787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d815d380 msgr2=0x7fb1d80ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d815d380 0x7fb1d80ce770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0098f0 tx=0x7fb1cc009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:33.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 -- 172.21.15.161:0/3673164787 shutdown_connections 2023-08-10T10:29:33.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80cdad0 0x7fb1d806ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/3673164787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d815d380 0x7fb1d80ce770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 -- 172.21.15.161:0/3673164787 >> 172.21.15.161:0/3673164787 conn(0x7fb1d80cf4c0 msgr2=0x7fb1d80cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:33.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 -- 172.21.15.161:0/3673164787 shutdown_connections 2023-08-10T10:29:33.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.864+0000 7fb1de3c6700 1 -- 172.21.15.161:0/3673164787 wait complete. 2023-08-10T10:29:33.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 Processor -- start 2023-08-10T10:29:33.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 -- start start 2023-08-10T10:29:33.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80cdad0 0x7fb1d814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d815d380 0x7fb1d80b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8158440 con 0x7fb1d80cecb0 2023-08-10T10:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c7610 con 0x7fb1d80cdad0 2023-08-10T10:29:33.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.866+0000 7fb1de3c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c78f0 con 0x7fb1d815d380 2023-08-10T10:29:33.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60768/0 (socket says 172.21.15.161:60768) 2023-08-10T10:29:33.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 -- 172.21.15.161:0/192778813 learned_addr learned my addr 172.21.15.161:0/192778813 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:33.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1dc963700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d815d380 0x7fb1d80b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d7fff700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80cdad0 0x7fb1d814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 -- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d815d380 msgr2=0x7fb1d80b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d815d380 0x7fb1d80b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 -- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80cdad0 msgr2=0x7fb1d814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80cdad0 0x7fb1d814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 -- 172.21.15.161:0/192778813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc009550 con 0x7fb1d80cecb0 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d77fe700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c4e0 tx=0x7fb1c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80052d0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8005430 con 0x7fb1d80cecb0 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80c7bd0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80038c0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.867+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d81501c0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.868+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d80c80f0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.869+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1c8003a20 con 0x7fb1d80cecb0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.869+0000 7fb1d4ff9700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 0x7fb1c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.869+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1c80889a0 con 0x7fb1d80cecb0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.869+0000 7fb1d7fff700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 0x7fb1c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:33.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.869+0000 7fb1d7fff700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 0x7fb1c406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009c40 tx=0x7fb1cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:33.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:33.873+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb1d80c80f0 con 0x7fb1d80cecb0 2023-08-10T10:29:34.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.057+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1d80c80f0 con 0x7fb1d80cecb0 2023-08-10T10:29:34.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.058+0000 7fb1d4ff9700 1 -- 172.21.15.161:0/192778813 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1c8017020 con 0x7fb1d80cecb0 2023-08-10T10:29:34.059 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:34.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 msgr2=0x7fb1c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 0x7fb1c406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009c40 tx=0x7fb1cc008030 comp rx=0 tx=0).stop 2023-08-10T10:29:34.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 msgr2=0x7fb1d80b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c4e0 tx=0x7fb1c800c8a0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 shutdown_connections 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb1c406ace0 0x7fb1c406d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d815d380 0x7fb1d80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80cdad0 0x7fb1d814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 --2- 172.21.15.161:0/192778813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1d80cecb0 0x7fb1d80b4750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 >> 172.21.15.161:0/192778813 conn(0x7fb1d80cf4c0 msgr2=0x7fb1d80703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 shutdown_connections 2023-08-10T10:29:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.060+0000 7fb1de3c6700 1 -- 172.21.15.161:0/192778813 wait complete. 2023-08-10T10:29:34.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.196+0000 7f0b21a58700 1 Processor -- start 2023-08-10T10:29:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.196+0000 7f0b21a58700 1 -- start start 2023-08-10T10:29:34.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b21a58700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b1c0cfcd0 0x7f0b1c0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b21a58700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0cead0 con 0x7f0b1c0d0210 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b21a58700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0cedb0 con 0x7f0b1c160910 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b21a58700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c0cf090 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1a7fc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0b1c0d0210 0x7f0b1c0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37784/0 (socket says 172.21.15.161:37784) 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1a7fc700 1 -- 172.21.15.161:0/1557882776 learned_addr learned my addr 172.21.15.161:0/1557882776 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1b7fe700 1 --2- 172.21.15.161:0/1557882776 >> v2:172.21.15.175:3300/0 conn(0x7f0b1c0cfcd0 0x7f0b1c0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699545857 0 0) 0x7f0b1c0cead0 con 0x7f0b1c0d0210 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b040035b0 con 0x7f0b1c0d0210 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4204758218 0 0) 0x7f0b040035b0 con 0x7f0b1c0d0210 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/1557882776 >> v1:172.21.15.175:6789/0 conn(0x7f0b1c160910 legacy=0x7f0b1c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/1557882776 >> v1:172.21.15.161:6789/0 conn(0x7f0b1c0d0210 legacy=0x7f0b1c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/1557882776 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0b2c40 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.197+0000 7f0b1b7fe700 1 --2- 172.21.15.161:0/1557882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c0d3ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009d90 tx=0x7f0b1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6095a1cc80f9ca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400e070 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14003a20 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b19ffb700 1 -- 172.21.15.161:0/1557882776 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10001670 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 -- 172.21.15.161:0/1557882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 msgr2=0x7f0b1c0d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 --2- 172.21.15.161:0/1557882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c0d3ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009d90 tx=0x7f0b1400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 -- 172.21.15.161:0/1557882776 shutdown_connections 2023-08-10T10:29:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 --2- 172.21.15.161:0/1557882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c0d3ba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 -- 172.21.15.161:0/1557882776 >> 172.21.15.161:0/1557882776 conn(0x7f0b1c0d3080 msgr2=0x7f0b1c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 -- 172.21.15.161:0/1557882776 shutdown_connections 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.198+0000 7f0b21a58700 1 -- 172.21.15.161:0/1557882776 wait complete. 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.199+0000 7f0b21a58700 1 Processor -- start 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.199+0000 7f0b21a58700 1 -- start start 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b1c160910 0x7f0b1c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c6d50 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c7030 con 0x7f0b1c0cfcd0 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b21a58700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c7310 con 0x7f0b1c160910 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b1b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b1b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60784/0 (socket says 172.21.15.161:60784) 2023-08-10T10:29:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.200+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/3462464171 learned_addr learned my addr 172.21.15.161:0/3462464171 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1affd700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1a7fc700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b1c160910 0x7f0b1c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b1c160910 msgr2=0x7f0b1c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b1c160910 0x7f0b1c0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 msgr2=0x7f0b1c1f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c1f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 -- 172.21.15.161:0/3462464171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14009a70 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1affd700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b1b7fe700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b14004000 tx=0x7f0b14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14004640 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b140047a0 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c0c75f0 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1401d670 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.201+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c0cd300 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.202+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c0c7b10 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.202+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b1401d7d0 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.203+0000 7f0b03fff700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 0x7f0b0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.203+0000 7f0b1affd700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 0x7f0b0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.203+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b1408ab00 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.203+0000 7f0b1affd700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 0x7f0b0806d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000f60 tx=0x7f0b0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.207+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0b1c0c7b10 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.395+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b1c0c7b10 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.395+0000 7f0b03fff700 1 -- 172.21.15.161:0/3462464171 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b1c0c7b10 con 0x7f0b1c0c7df0 2023-08-10T10:29:34.397 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:34.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 msgr2=0x7f0b0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 0x7f0b0806d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000f60 tx=0x7f0b0c009040 comp rx=0 tx=0).stop 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 msgr2=0x7f0b1c0c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b14004000 tx=0x7f0b14004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 shutdown_connections 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f0b0806ace0 0x7f0b0806d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c0c7df0 0x7f0b1c0c8280 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b1c0cfcd0 0x7f0b1c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 --2- 172.21.15.161:0/3462464171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b1c160910 0x7f0b1c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 >> 172.21.15.161:0/3462464171 conn(0x7f0b1c0d3080 msgr2=0x7f0b1c15f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 shutdown_connections 2023-08-10T10:29:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.397+0000 7f0b21a58700 1 -- 172.21.15.161:0/3462464171 wait complete. 2023-08-10T10:29:34.410 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.535+0000 7f7a3f71f700 1 Processor -- start 2023-08-10T10:29:34.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.535+0000 7f7a3f71f700 1 -- start start 2023-08-10T10:29:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 0x7f7a380b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a38160d20 0x7f7a380cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a380cf730 0x7f7a3806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a38071950 con 0x7f7a38160d20 2023-08-10T10:29:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380cfb80 con 0x7f7a380cf730 2023-08-10T10:29:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3f71f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380b2660 con 0x7f7a380cb9f0 2023-08-10T10:29:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3ccba700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a38160d20 0x7f7a380cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3ccba700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a38160d20 0x7f7a380cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60790/0 (socket says 172.21.15.161:60790) 2023-08-10T10:29:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3ccba700 1 -- 172.21.15.161:0/1860111587 learned_addr learned my addr 172.21.15.161:0/1860111587 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3dcbc700 1 --2- 172.21.15.161:0/1860111587 >> v2:172.21.15.175:3300/0 conn(0x7f7a380cf730 0x7f7a3806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.536+0000 7f7a3d4bb700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 0x7f7a380b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 -- 172.21.15.161:0/1860111587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 msgr2=0x7f7a380b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 0x7f7a380b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 -- 172.21.15.161:0/1860111587 >> v2:172.21.15.175:3300/0 conn(0x7f7a380cf730 msgr2=0x7f7a3806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/1860111587 >> v2:172.21.15.175:3300/0 conn(0x7f7a380cf730 0x7f7a3806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 -- 172.21.15.161:0/1860111587 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3806dc10 con 0x7f7a38160d20 2023-08-10T10:29:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3d4bb700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 0x7f7a380b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a38160d20 0x7f7a380cf1f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a38070620 tx=0x7f7a34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97cec4a0b09fd70 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a2ffff700 1 -- 172.21.15.161:0/1860111587 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400b870 con 0x7f7a38160d20 2023-08-10T10:29:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a2ffff700 1 -- 172.21.15.161:0/1860111587 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400b9d0 con 0x7f7a38160d20 2023-08-10T10:29:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a2ffff700 1 -- 172.21.15.161:0/1860111587 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400bd60 con 0x7f7a38160d20 2023-08-10T10:29:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 -- 172.21.15.161:0/1860111587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a38160d20 msgr2=0x7f7a380cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a38160d20 0x7f7a380cf1f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a38070620 tx=0x7f7a34009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 -- 172.21.15.161:0/1860111587 shutdown_connections 2023-08-10T10:29:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/1860111587 >> v2:172.21.15.175:3300/0 conn(0x7f7a380cf730 0x7f7a3806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cb9f0 0x7f7a380b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/1860111587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a38160d20 0x7f7a380cf1f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.537+0000 7f7a3f71f700 1 -- 172.21.15.161:0/1860111587 >> 172.21.15.161:0/1860111587 conn(0x7f7a380cc740 msgr2=0x7f7a380ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.538+0000 7f7a3f71f700 1 -- 172.21.15.161:0/1860111587 shutdown_connections 2023-08-10T10:29:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.538+0000 7f7a3f71f700 1 -- 172.21.15.161:0/1860111587 wait complete. 2023-08-10T10:29:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.539+0000 7f7a3f71f700 1 Processor -- start 2023-08-10T10:29:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.539+0000 7f7a3f71f700 1 -- start start 2023-08-10T10:29:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cf730 0x7f7a380b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a38160d20 0x7f7a380ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380c4850 con 0x7f7a380cb9f0 2023-08-10T10:29:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380c3bd0 con 0x7f7a38160d20 2023-08-10T10:29:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3f71f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380c3eb0 con 0x7f7a380cf730 2023-08-10T10:29:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60794/0 (socket says 172.21.15.161:60794) 2023-08-10T10:29:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 -- 172.21.15.161:0/3655427421 learned_addr learned my addr 172.21.15.161:0/3655427421 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3dcbc700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a38160d20 0x7f7a380ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cf730 0x7f7a380b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 -- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cf730 msgr2=0x7f7a380b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cf730 0x7f7a380b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 -- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a38160d20 msgr2=0x7f7a380ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a38160d20 0x7f7a380ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.540+0000 7f7a3d4bb700 1 -- 172.21.15.161:0/3655427421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34009550 con 0x7f7a380cb9f0 2023-08-10T10:29:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a3d4bb700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c7f0 tx=0x7f7a2800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28011800 con 0x7f7a380cb9f0 2023-08-10T10:29:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28011960 con 0x7f7a380cb9f0 2023-08-10T10:29:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a380c4190 con 0x7f7a380cb9f0 2023-08-10T10:29:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28011d10 con 0x7f7a380cb9f0 2023-08-10T10:29:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.541+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a380c37f0 con 0x7f7a380cb9f0 2023-08-10T10:29:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.542+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a38160b10 con 0x7f7a380cb9f0 2023-08-10T10:29:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.542+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a28018360 con 0x7f7a380cb9f0 2023-08-10T10:29:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.543+0000 7f7a2dffb700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.543+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a280893b0 con 0x7f7a380cb9f0 2023-08-10T10:29:34.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.543+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.543+0000 7f7a3ccba700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009c10 tx=0x7f7a34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.547+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a38160b10 con 0x7f7a380cb9f0 2023-08-10T10:29:34.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.733+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a38160b10 con 0x7f7a380cb9f0 2023-08-10T10:29:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.734+0000 7f7a2dffb700 1 -- 172.21.15.161:0/3655427421 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a38160b10 con 0x7f7a380cb9f0 2023-08-10T10:29:34.761 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:34.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 msgr2=0x7f7a1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009c10 tx=0x7f7a34008030 comp rx=0 tx=0).stop 2023-08-10T10:29:34.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 msgr2=0x7f7a3815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c7f0 tx=0x7f7a2800cb00 comp rx=0 tx=0).stop 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 shutdown_connections 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a38160d20 0x7f7a380ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a380cb9f0 0x7f7a3815e460 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 --2- 172.21.15.161:0/3655427421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a380cf730 0x7f7a380b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 >> 172.21.15.161:0/3655427421 conn(0x7f7a380cc740 msgr2=0x7f7a381601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 shutdown_connections 2023-08-10T10:29:34.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.736+0000 7f7a3f71f700 1 -- 172.21.15.161:0/3655427421 wait complete. 2023-08-10T10:29:34.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:34.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.886+0000 7f52c4656700 1 Processor -- start 2023-08-10T10:29:34.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.886+0000 7f52c4656700 1 -- start start 2023-08-10T10:29:34.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.887+0000 7f52c4656700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.887+0000 7f52c4656700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0cead0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.887+0000 7f52c4656700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0cedb0 con 0x7f52bc0d0210 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.887+0000 7f52c4656700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0cf090 con 0x7f52bc160910 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c2bf3700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f52bc0cfcd0 0x7f52bc0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37812/0 (socket says 172.21.15.161:37812) 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c2bf3700 1 -- 172.21.15.161:0/4137772656 learned_addr learned my addr 172.21.15.161:0/4137772656 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:34.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c23f2700 1 --2- 172.21.15.161:0/4137772656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034895623 0 0) 0x7f52bc0cead0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a80035b0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312813766 0 0) 0x7f52bc0cedb0 con 0x7f52bc0d0210 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc0cead0 con 0x7f52bc0d0210 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c23f2700 1 -- 172.21.15.161:0/4137772656 >> v1:172.21.15.175:6789/0 conn(0x7f52bc0d0210 legacy=0x7f52bc0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c23f2700 1 -- 172.21.15.161:0/4137772656 >> v1:172.21.15.161:6789/0 conn(0x7f52bc0cfcd0 legacy=0x7f52bc0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c23f2700 1 -- 172.21.15.161:0/4137772656 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0b2c40 con 0x7f52bc160910 2023-08-10T10:29:34.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c23f2700 1 --2- 172.21.15.161:0/4137772656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0d3ba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009870 tx=0x7f52ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d7e11e2a9a241f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac011830 con 0x7f52bc160910 2023-08-10T10:29:34.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac011990 con 0x7f52bc160910 2023-08-10T10:29:34.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.888+0000 7f52c13f0700 1 -- 172.21.15.161:0/4137772656 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac011d00 con 0x7f52bc160910 2023-08-10T10:29:34.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 -- 172.21.15.161:0/4137772656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 msgr2=0x7f52bc0d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 --2- 172.21.15.161:0/4137772656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0d3ba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009870 tx=0x7f52ac009b80 comp rx=0 tx=0).stop 2023-08-10T10:29:34.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 -- 172.21.15.161:0/4137772656 shutdown_connections 2023-08-10T10:29:34.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 --2- 172.21.15.161:0/4137772656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0d3ba0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 -- 172.21.15.161:0/4137772656 >> 172.21.15.161:0/4137772656 conn(0x7f52bc0d3080 msgr2=0x7f52bc0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 -- 172.21.15.161:0/4137772656 shutdown_connections 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.889+0000 7f52c4656700 1 -- 172.21.15.161:0/4137772656 wait complete. 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.891+0000 7f52c4656700 1 Processor -- start 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.891+0000 7f52c4656700 1 -- start start 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc0c7fe0 0x7f52bc0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c8d50 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c84b0 con 0x7f52bc0c7fe0 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c8790 con 0x7f52bc160910 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60808/0 (socket says 172.21.15.161:60808) 2023-08-10T10:29:34.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 -- 172.21.15.161:0/3998261968 learned_addr learned my addr 172.21.15.161:0/3998261968 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c2bf3700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc0c7fe0 0x7f52bc0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c1bf1700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 -- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 msgr2=0x7f52bc0b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 -- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc0c7fe0 msgr2=0x7f52bc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc0c7fe0 0x7f52bc0b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 -- 172.21.15.161:0/3998261968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0094a0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c1bf1700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c23f2700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0045d0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac01f070 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0c8a70 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0038c0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.892+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc0c6cd0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.893+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0ca4e0 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.894+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52ac003a20 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.894+0000 7f52b2ffd700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 0x7f52a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:34.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.894+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52ac021070 con 0x7f52bc0cfcd0 2023-08-10T10:29:34.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.894+0000 7f52c1bf1700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 0x7f52a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:34.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.894+0000 7f52c1bf1700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 0x7f52a006d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0cd1a0 tx=0x7f52b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:34.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:34.898+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f52bc0ca4e0 con 0x7f52bc0cfcd0 2023-08-10T10:29:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.085+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52bc0ca4e0 con 0x7f52bc0cfcd0 2023-08-10T10:29:35.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.086+0000 7f52b2ffd700 1 -- 172.21.15.161:0/3998261968 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52bc0ca4e0 con 0x7f52bc0cfcd0 2023-08-10T10:29:35.087 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:35.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 msgr2=0x7f52a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 0x7f52a006d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0cd1a0 tx=0x7f52b8009040 comp rx=0 tx=0).stop 2023-08-10T10:29:35.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 msgr2=0x7f52bc0c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac004750 comp rx=0 tx=0).stop 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 shutdown_connections 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f52a006ace0 0x7f52a006d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc0c7fe0 0x7f52bc0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52bc0cfcd0 0x7f52bc0c7aa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 --2- 172.21.15.161:0/3998261968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc160910 0x7f52bc0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 >> 172.21.15.161:0/3998261968 conn(0x7f52bc0d3080 msgr2=0x7f52bc15f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 shutdown_connections 2023-08-10T10:29:35.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.088+0000 7f52c4656700 1 -- 172.21.15.161:0/3998261968 wait complete. 2023-08-10T10:29:35.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:35.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.221+0000 7f38c9712700 1 Processor -- start 2023-08-10T10:29:35.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.222+0000 7f38c9712700 1 -- start start 2023-08-10T10:29:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c9712700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c9712700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c9712700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c40cc780 con 0x7f38c415b050 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c9712700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40ccd40 con 0x7f38c40cd7e0 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c9712700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40ce1d0 con 0x7f38c40c52c0 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c27fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:45990/0 (socket says 172.21.15.161:45990) 2023-08-10T10:29:35.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c27fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59620/0 (socket says 172.21.15.161:59620) 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 -- 172.21.15.161:0/4085404098 learned_addr learned my addr 172.21.15.161:0/4085404098 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c2ffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f38c415b050 0x7f38c40d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39614/0 (socket says 172.21.15.161:39614) 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c1ffb700 1 -- 172.21.15.161:0/4085404098 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626000166 0 0) 0x7f38c40cc780 con 0x7f38c415b050 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 -- 172.21.15.161:0/4085404098 >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 msgr2=0x7f38c40cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 --2- 172.21.15.161:0/4085404098 >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 -- 172.21.15.161:0/4085404098 >> v1:172.21.15.175:6789/0 conn(0x7f38c415b050 legacy=0x7f38c40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c37fe700 1 -- 172.21.15.161:0/4085404098 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40cca60 con 0x7f38c40c52c0 2023-08-10T10:29:35.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.223+0000 7f38c27fc700 1 --2- 172.21.15.161:0/4085404098 >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:35.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c37fe700 1 --2- 172.21.15.161:0/4085404098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1936cfa3d6194cec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c1ffb700 1 -- 172.21.15.161:0/4085404098 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00e070 con 0x7f38c40c52c0 2023-08-10T10:29:35.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c1ffb700 1 -- 172.21.15.161:0/4085404098 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b910 con 0x7f38c40c52c0 2023-08-10T10:29:35.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c1ffb700 1 -- 172.21.15.161:0/4085404098 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bcc0 con 0x7f38c40c52c0 2023-08-10T10:29:35.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 -- 172.21.15.161:0/4085404098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 msgr2=0x7f38c40c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 --2- 172.21.15.161:0/4085404098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 -- 172.21.15.161:0/4085404098 shutdown_connections 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 --2- 172.21.15.161:0/4085404098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c40c52c0 0x7f38c40c56d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 --2- 172.21.15.161:0/4085404098 >> v2:172.21.15.175:3300/0 conn(0x7f38c40cd7e0 0x7f38c40cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 -- 172.21.15.161:0/4085404098 >> 172.21.15.161:0/4085404098 conn(0x7f38c409a150 msgr2=0x7f38c40d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 -- 172.21.15.161:0/4085404098 shutdown_connections 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.224+0000 7f38c9712700 1 -- 172.21.15.161:0/4085404098 wait complete. 2023-08-10T10:29:35.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.226+0000 7f38c9712700 1 Processor -- start 2023-08-10T10:29:35.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.226+0000 7f38c9712700 1 -- start start 2023-08-10T10:29:35.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c40cd7e0 0x7f38c40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c415b050 0x7f38c40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c9fb0 con 0x7f38c40c52c0 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41f0a80 con 0x7f38c40cd7e0 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c9712700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c93a0 con 0x7f38c415b050 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60822/0 (socket says 172.21.15.161:60822) 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 -- 172.21.15.161:0/3600286288 learned_addr learned my addr 172.21.15.161:0/3600286288 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c37fe700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c415b050 0x7f38c40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c27fc700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c40cd7e0 0x7f38c40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 -- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c415b050 msgr2=0x7f38c40b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c415b050 0x7f38c40b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 -- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c40cd7e0 msgr2=0x7f38c40b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c40cd7e0 0x7f38c40b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.227+0000 7f38c2ffd700 1 -- 172.21.15.161:0/3600286288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40094a0 con 0x7f38c40c52c0 2023-08-10T10:29:35.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38c2ffd700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38b800c5a0 tx=0x7f38b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004cd0 con 0x7f38c40c52c0 2023-08-10T10:29:35.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8004e30 con 0x7f38c40c52c0 2023-08-10T10:29:35.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc009b30 con 0x7f38c40c52c0 2023-08-10T10:29:35.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8007310 con 0x7f38c40c52c0 2023-08-10T10:29:35.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.228+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c40c9960 con 0x7f38c40c52c0 2023-08-10T10:29:35.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.229+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40744e0 con 0x7f38c40c52c0 2023-08-10T10:29:35.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.229+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38b8007470 con 0x7f38c40c52c0 2023-08-10T10:29:35.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.230+0000 7f38ab7fe700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 0x7f38b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.230+0000 7f38c27fc700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 0x7f38b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.230+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38b80892c0 con 0x7f38c40c52c0 2023-08-10T10:29:35.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.230+0000 7f38c27fc700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 0x7f38b006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38c4143fd0 tx=0x7f38b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.234+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38b80542f0 con 0x7f38c40c52c0 2023-08-10T10:29:35.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.421+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c40b2810 con 0x7f38c40c52c0 2023-08-10T10:29:35.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.423+0000 7f38ab7fe700 1 -- 172.21.15.161:0/3600286288 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f38b8057910 con 0x7f38c40c52c0 2023-08-10T10:29:35.424 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:35.424 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:35.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 msgr2=0x7f38b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 0x7f38b006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38c4143fd0 tx=0x7f38b4008040 comp rx=0 tx=0).stop 2023-08-10T10:29:35.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 msgr2=0x7f38c40ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38b800c5a0 tx=0x7f38b800c960 comp rx=0 tx=0).stop 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 shutdown_connections 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f38b006ace0 0x7f38b006d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38c415b050 0x7f38c40b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38c40c52c0 0x7f38c40ca440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 --2- 172.21.15.161:0/3600286288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c40cd7e0 0x7f38c40b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 >> 172.21.15.161:0/3600286288 conn(0x7f38c409a150 msgr2=0x7f38c406f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 shutdown_connections 2023-08-10T10:29:35.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.425+0000 7f38c9712700 1 -- 172.21.15.161:0/3600286288 wait complete. 2023-08-10T10:29:35.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:35.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.562+0000 7fe7d5dbb700 1 Processor -- start 2023-08-10T10:29:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.562+0000 7fe7d5dbb700 1 -- start start 2023-08-10T10:29:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7d5dbb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7d015e5e0 0x7fe7d00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7d5dbb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d015e9c0 con 0x7fe7d00cb920 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7d5dbb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00cc1c0 con 0x7fe7d00cde10 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7d5dbb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00cc4a0 con 0x7fe7d015e5e0 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7ceffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe7d00cb920 0x7fe7d00cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37836/0 (socket says 172.21.15.161:37836) 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7ceffd700 1 -- 172.21.15.161:0/4223407307 learned_addr learned my addr 172.21.15.161:0/4223407307 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7cf7fe700 1 --2- 172.21.15.161:0/4223407307 >> v2:172.21.15.175:3300/0 conn(0x7fe7d015e5e0 0x7fe7d00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7ce7fc700 1 -- 172.21.15.161:0/4223407307 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909558193 0 0) 0x7fe7d015e9c0 con 0x7fe7d00cb920 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7ce7fc700 1 -- 172.21.15.161:0/4223407307 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b80035b0 con 0x7fe7d00cb920 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4223407307 >> v1:172.21.15.175:6789/0 conn(0x7fe7d00cde10 legacy=0x7fe7d00b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4223407307 >> v1:172.21.15.161:6789/0 conn(0x7fe7d00cb920 legacy=0x7fe7d00cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4223407307 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00cc780 con 0x7fe7d015e5e0 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.563+0000 7fe7cf7fe700 1 --2- 172.21.15.161:0/4223407307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d015e5e0 0x7fe7d00cfa30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009840 tx=0x7fe7c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d976a5f6949fb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7ce7fc700 1 -- 172.21.15.161:0/4223407307 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0011830 con 0x7fe7d015e5e0 2023-08-10T10:29:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7ce7fc700 1 -- 172.21.15.161:0/4223407307 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0011990 con 0x7fe7d015e5e0 2023-08-10T10:29:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7ce7fc700 1 -- 172.21.15.161:0/4223407307 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0011d00 con 0x7fe7d015e5e0 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4223407307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d015e5e0 msgr2=0x7fe7d00cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4223407307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d015e5e0 0x7fe7d00cfa30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009840 tx=0x7fe7c0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4223407307 shutdown_connections 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4223407307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d015e5e0 0x7fe7d00cfa30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4223407307 >> 172.21.15.161:0/4223407307 conn(0x7fe7d009a140 msgr2=0x7fe7d00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4223407307 shutdown_connections 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.564+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4223407307 wait complete. 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.565+0000 7fe7d5dbb700 1 Processor -- start 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 -- start start 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 0x7fe7d014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 0x7fe7d0150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01f1750 con 0x7fe7d00cb920 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01f0920 con 0x7fe7d00cde10 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7d5dbb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01f0b80 con 0x7fe7d015e5e0 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60834/0 (socket says 172.21.15.161:60834) 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.566+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4030628072 learned_addr learned my addr 172.21.15.161:0/4030628072 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cffff700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 0x7fe7d0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7ceffd700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 0x7fe7d014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 msgr2=0x7fe7d0150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 0x7fe7d0150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 msgr2=0x7fe7d014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 0x7fe7d014dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 -- 172.21.15.161:0/4030628072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00094a0 con 0x7fe7d00cb920 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cffff700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 0x7fe7d0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7ceffd700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 0x7fe7d014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7cf7fe700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009fd0 tx=0x7fe7c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00036a0 con 0x7fe7d00cb920 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c001f070 con 0x7fe7d00cb920 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d01f0e20 con 0x7fe7d00cb920 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0003a60 con 0x7fe7d00cb920 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.567+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d01f13e0 con 0x7fe7d00cb920 2023-08-10T10:29:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.568+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d004ecc0 con 0x7fe7d00cb920 2023-08-10T10:29:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.568+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7c0003bc0 con 0x7fe7d00cb920 2023-08-10T10:29:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.569+0000 7fe7b7fff700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 0x7fe7bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.569+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7c0021070 con 0x7fe7d00cb920 2023-08-10T10:29:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.569+0000 7fe7ceffd700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 0x7fe7bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.569+0000 7fe7ceffd700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 0x7fe7bc06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7d006e500 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.573+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7c0055ef0 con 0x7fe7d00cb920 2023-08-10T10:29:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.762+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7d006e530 con 0x7fe7d00cb920 2023-08-10T10:29:35.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.762+0000 7fe7b7fff700 1 -- 172.21.15.161:0/4030628072 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7c00150a0 con 0x7fe7d00cb920 2023-08-10T10:29:35.764 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 msgr2=0x7fe7bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 0x7fe7bc06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7d006e500 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 msgr2=0x7fe7d00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009fd0 tx=0x7fe7c0004750 comp rx=0 tx=0).stop 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 shutdown_connections 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe7bc06ace0 0x7fe7bc06d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d015e5e0 0x7fe7d0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7d00cb920 0x7fe7d00ca5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 --2- 172.21.15.161:0/4030628072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d00cde10 0x7fe7d014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.764+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 >> 172.21.15.161:0/4030628072 conn(0x7fe7d009a140 msgr2=0x7fe7d015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.765+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 shutdown_connections 2023-08-10T10:29:35.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.765+0000 7fe7d5dbb700 1 -- 172.21.15.161:0/4030628072 wait complete. 2023-08-10T10:29:35.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:35.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.901+0000 7f52772c0700 1 Processor -- start 2023-08-10T10:29:35.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.901+0000 7f52772c0700 1 -- start start 2023-08-10T10:29:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f52772c0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52700cef20 0x7f52700ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f52772c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f52772c0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5270071f60 con 0x7f527015b380 2023-08-10T10:29:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f52772c0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527006a8a0 con 0x7f52700cef20 2023-08-10T10:29:35.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f52772c0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270072710 con 0x7f52700ce6f0 2023-08-10T10:29:35.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527485b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52700cef20 0x7f52700ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527585d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527485b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52700cef20 0x7f52700ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59646/0 (socket says 172.21.15.161:59646) 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527585d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:46016/0 (socket says 172.21.15.161:46016) 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527505c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f527015b380 0x7f527006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39640/0 (socket says 172.21.15.161:39640) 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.902+0000 7f527485b700 1 -- 172.21.15.161:0/16616428 learned_addr learned my addr 172.21.15.161:0/16616428 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527485b700 1 -- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 msgr2=0x7f527015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527485b700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527485b700 1 -- 172.21.15.161:0/16616428 >> v1:172.21.15.175:6789/0 conn(0x7f527015b380 legacy=0x7f527006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527485b700 1 -- 172.21.15.161:0/16616428 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270072190 con 0x7f52700cef20 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f5267fff700 1 -- 172.21.15.161:0/16616428 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437766741 0 0) 0x7f5270071f60 con 0x7f527015b380 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527585d700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f527485b700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700cef20 0x7f52700ce1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f526c0098f0 tx=0x7f526c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e29b32e0ec104b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f5267fff700 1 -- 172.21.15.161:0/16616428 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011830 con 0x7f52700cef20 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f5267fff700 1 -- 172.21.15.161:0/16616428 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c011990 con 0x7f52700cef20 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.903+0000 7f5267fff700 1 -- 172.21.15.161:0/16616428 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011d20 con 0x7f52700cef20 2023-08-10T10:29:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 -- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700cef20 msgr2=0x7f52700ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700cef20 0x7f52700ce1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f526c0098f0 tx=0x7f526c009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 -- 172.21.15.161:0/16616428 shutdown_connections 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f527015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 --2- 172.21.15.161:0/16616428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700cef20 0x7f52700ce1b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 -- 172.21.15.161:0/16616428 >> 172.21.15.161:0/16616428 conn(0x7f52700cf4c0 msgr2=0x7f52700cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 -- 172.21.15.161:0/16616428 shutdown_connections 2023-08-10T10:29:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.904+0000 7f52772c0700 1 -- 172.21.15.161:0/16616428 wait complete. 2023-08-10T10:29:35.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.905+0000 7f52772c0700 1 Processor -- start 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.905+0000 7f52772c0700 1 -- start start 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f52700c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 0x7f527014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527015b770 con 0x7f52700cef20 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700c4820 con 0x7f52700b2e00 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700b33d0 con 0x7f52700ce6f0 2023-08-10T10:29:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60850/0 (socket says 172.21.15.161:60850) 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 -- 172.21.15.161:0/1930670777 learned_addr learned my addr 172.21.15.161:0/1930670777 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527505c700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f52700c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527585d700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 0x7f527014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 -- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 msgr2=0x7f52700c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f52700c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 -- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 msgr2=0x7f527014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 0x7f527014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 -- 172.21.15.161:0/1930670777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268009a70 con 0x7f52700cef20 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527585d700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 0x7f527014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f527485b700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f526c009c40 tx=0x7f526c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c004300 con 0x7f52700cef20 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c01f070 con 0x7f52700cef20 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c009550 con 0x7f52700cef20 2023-08-10T10:29:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.906+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0036a0 con 0x7f52700cef20 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.907+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700c44b0 con 0x7f52700cef20 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.908+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700c49d0 con 0x7f52700cef20 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.908+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f526c021030 con 0x7f52700cef20 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.908+0000 7f5265ffb700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 0x7f525406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.909+0000 7f527505c700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 0x7f525406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.909+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f526c08a760 con 0x7f52700cef20 2023-08-10T10:29:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.909+0000 7f527505c700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 0x7f525406d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5260000f60 tx=0x7f5260007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:35.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:35.913+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f52700c49d0 con 0x7f52700cef20 2023-08-10T10:29:36.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.100+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52700c4990 con 0x7f52700cef20 2023-08-10T10:29:36.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.100+0000 7f5265ffb700 1 -- 172.21.15.161:0/1930670777 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f526c055920 con 0x7f52700cef20 2023-08-10T10:29:36.102 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:36.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 msgr2=0x7f525406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 0x7f525406d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5260000f60 tx=0x7f5260007e70 comp rx=0 tx=0).stop 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 msgr2=0x7f52700c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f526c009c40 tx=0x7f526c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 shutdown_connections 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f525406ace0 0x7f525406d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52700b2e00 0x7f527014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52700ce6f0 0x7f52700c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 --2- 172.21.15.161:0/1930670777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52700cef20 0x7f52700c88a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 >> 172.21.15.161:0/1930670777 conn(0x7f52700cf4c0 msgr2=0x7f5270159870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 shutdown_connections 2023-08-10T10:29:36.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.102+0000 7f52772c0700 1 -- 172.21.15.161:0/1930670777 wait complete. 2023-08-10T10:29:36.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.239+0000 7f2b8edc3700 1 Processor -- start 2023-08-10T10:29:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.239+0000 7f2b8edc3700 1 -- start start 2023-08-10T10:29:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8edc3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b8815e4f0 0x7f2b880cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8edc3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815abb0 con 0x7f2b88159fd0 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8edc3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815ae90 con 0x7f2b880b1740 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8edc3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8815b170 con 0x7f2b8815e4f0 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8cb5f700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2b88159fd0 0x7f2b8815a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37862/0 (socket says 172.21.15.161:37862) 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b8cb5f700 1 -- 172.21.15.161:0/2908397613 learned_addr learned my addr 172.21.15.161:0/2908397613 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b87fff700 1 --2- 172.21.15.161:0/2908397613 >> v2:172.21.15.175:3300/0 conn(0x7f2b8815e4f0 0x7f2b880cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075324787 0 0) 0x7f2b8815abb0 con 0x7f2b88159fd0 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b780057c0 con 0x7f2b88159fd0 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196071225 0 0) 0x7f2b780057c0 con 0x7f2b88159fd0 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 >> v2:172.21.15.175:3300/0 conn(0x7f2b8815e4f0 msgr2=0x7f2b880cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 --2- 172.21.15.161:0/2908397613 >> v2:172.21.15.175:3300/0 conn(0x7f2b8815e4f0 0x7f2b880cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 >> v1:172.21.15.175:6789/0 conn(0x7f2b880b1740 legacy=0x7f2b880cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.240+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880cac90 con 0x7f2b88159fd0 2023-08-10T10:29:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f2b7c001670 con 0x7f2b88159fd0 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 >> v1:172.21.15.161:6789/0 conn(0x7f2b88159fd0 legacy=0x7f2b8815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78005c10 0x7f2b78006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 0x7f2b78006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b78007420 0x7f2b7800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815b170 con 0x7f2b78006a60 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7800e2c0 con 0x7f2b78007420 2023-08-10T10:29:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7800e480 con 0x7f2b78005c10 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 0x7f2b78006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78005c10 0x7f2b78006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b8d360700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b78007420 0x7f2b7800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 -- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78005c10 msgr2=0x7f2b78006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78005c10 0x7f2b78006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 -- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b78007420 msgr2=0x7f2b7800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b78007420 0x7f2b7800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 -- 172.21.15.161:0/2908397613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780057c0 con 0x7f2b78006a60 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78005c10 0x7f2b78006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b8d360700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b78007420 0x7f2b7800dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b8d360700 1 -- 172.21.15.161:0/2908397613 reap_dead start 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b87fff700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 0x7f2b78006ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009b60 tx=0x7f2b78007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97811df1dda7e4e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400e6c0 con 0x7f2b78006a60 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400e820 con 0x7f2b78006a60 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.241+0000 7f2b877fe700 1 -- 172.21.15.161:0/2908397613 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400eb90 con 0x7f2b78006a60 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 -- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 msgr2=0x7f2b78006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 0x7f2b78006ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009b60 tx=0x7f2b78007a90 comp rx=0 tx=0).stop 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 -- 172.21.15.161:0/2908397613 shutdown_connections 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/2908397613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78006a60 0x7f2b78006ee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 -- 172.21.15.161:0/2908397613 >> 172.21.15.161:0/2908397613 conn(0x7f2b880cc740 msgr2=0x7f2b880ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 -- 172.21.15.161:0/2908397613 shutdown_connections 2023-08-10T10:29:36.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.242+0000 7f2b8edc3700 1 -- 172.21.15.161:0/2908397613 wait complete. 2023-08-10T10:29:36.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.243+0000 7f2b8edc3700 1 Processor -- start 2023-08-10T10:29:36.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.243+0000 7f2b8edc3700 1 -- start start 2023-08-10T10:29:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 0x7f2b8815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b880b1120 0x7f2b880aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815ba40 con 0x7f2b88145c00 2023-08-10T10:29:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881556b0 con 0x7f2b880b1120 2023-08-10T10:29:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.244+0000 7f2b8edc3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880b2fe0 con 0x7f2b78006a60 2023-08-10T10:29:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60872/0 (socket says 172.21.15.161:60872) 2023-08-10T10:29:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 -- 172.21.15.161:0/901318799 learned_addr learned my addr 172.21.15.161:0/901318799 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b87fff700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b880b1120 0x7f2b880aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 0x7f2b8815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 -- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 msgr2=0x7f2b8815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 0x7f2b8815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 -- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b880b1120 msgr2=0x7f2b880aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b880b1120 0x7f2b880aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 -- 172.21.15.161:0/901318799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b881465a0 con 0x7f2b88145c00 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 0x7f2b8815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8d360700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b880c6980 tx=0x7f2b8000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80003c10 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80003d70 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b88154d10 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80005310 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.245+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b881552d0 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.246+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b881557f0 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.247+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b80005470 con 0x7f2b88145c00 2023-08-10T10:29:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.247+0000 7f2b857fa700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 0x7f2b6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.247+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b80089360 con 0x7f2b88145c00 2023-08-10T10:29:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.247+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 0x7f2b6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.247+0000 7f2b8cb5f700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 0x7f2b6c06d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0017a0 tx=0x7f2b7c001190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.251+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2b881557f0 con 0x7f2b88145c00 2023-08-10T10:29:36.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.439+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b881557f0 con 0x7f2b88145c00 2023-08-10T10:29:36.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.439+0000 7f2b857fa700 1 -- 172.21.15.161:0/901318799 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b881557f0 con 0x7f2b88145c00 2023-08-10T10:29:36.441 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:36.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 msgr2=0x7f2b6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 0x7f2b6c06d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0017a0 tx=0x7f2b7c001190 comp rx=0 tx=0).stop 2023-08-10T10:29:36.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 msgr2=0x7f2b88146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b880c6980 tx=0x7f2b8000ee00 comp rx=0 tx=0).stop 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 shutdown_connections 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f2b6c06ace0 0x7f2b6c06d1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b88145c00 0x7f2b88146060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b78006a60 0x7f2b8815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 --2- 172.21.15.161:0/901318799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b880b1120 0x7f2b880aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 >> 172.21.15.161:0/901318799 conn(0x7f2b880cc740 msgr2=0x7f2b8806d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 shutdown_connections 2023-08-10T10:29:36.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.442+0000 7f2b8edc3700 1 -- 172.21.15.161:0/901318799 wait complete. 2023-08-10T10:29:36.455 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:36.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.578+0000 7f23cf958700 1 Processor -- start 2023-08-10T10:29:36.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.578+0000 7f23cf958700 1 -- start start 2023-08-10T10:29:36.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cf958700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23c815e5e0 0x7f23c80cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cf958700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c815e9c0 con 0x7f23c80cb920 2023-08-10T10:29:36.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cf958700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c80cc1c0 con 0x7f23c80cde10 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cf958700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80cc4a0 con 0x7f23c815e5e0 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cd6f4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23c815e5e0 0x7f23c80cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cd6f4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23c815e5e0 0x7f23c80cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60876/0 (socket says 172.21.15.161:60876) 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23cd6f4700 1 -- 172.21.15.161:0/3905315639 learned_addr learned my addr 172.21.15.161:0/3905315639 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.579+0000 7f23ccef3700 1 --1- 172.21.15.161:0/3905315639 >> v1:172.21.15.161:6789/0 conn(0x7f23c80cb920 0x7f23c80cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37882/0 (socket says 172.21.15.161:37882) 2023-08-10T10:29:36.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cd6f4700 1 -- 172.21.15.161:0/3905315639 >> v1:172.21.15.175:6789/0 conn(0x7f23c80cde10 legacy=0x7f23c80b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cd6f4700 1 -- 172.21.15.161:0/3905315639 >> v1:172.21.15.161:6789/0 conn(0x7f23c80cb920 legacy=0x7f23c80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cd6f4700 1 -- 172.21.15.161:0/3905315639 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80cc780 con 0x7f23c815e5e0 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23bffff700 1 -- 172.21.15.161:0/3905315639 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841586713 0 0) 0x7f23c815e9c0 con 0x7f23c80cb920 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cd6f4700 1 --2- 172.21.15.161:0/3905315639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c815e5e0 0x7f23c80cfa30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098f0 tx=0x7f23b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b086352bb41a361 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23bffff700 1 -- 172.21.15.161:0/3905315639 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004230 con 0x7f23c815e5e0 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23bffff700 1 -- 172.21.15.161:0/3905315639 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8004390 con 0x7f23c815e5e0 2023-08-10T10:29:36.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23bffff700 1 -- 172.21.15.161:0/3905315639 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b80036a0 con 0x7f23c815e5e0 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cf958700 1 -- 172.21.15.161:0/3905315639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c815e5e0 msgr2=0x7f23c80cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cf958700 1 --2- 172.21.15.161:0/3905315639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c815e5e0 0x7f23c80cfa30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098f0 tx=0x7f23b8009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cf958700 1 -- 172.21.15.161:0/3905315639 shutdown_connections 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cf958700 1 --2- 172.21.15.161:0/3905315639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c815e5e0 0x7f23c80cfa30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.580+0000 7f23cf958700 1 -- 172.21.15.161:0/3905315639 >> 172.21.15.161:0/3905315639 conn(0x7f23c809a140 msgr2=0x7f23c80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.581+0000 7f23cf958700 1 -- 172.21.15.161:0/3905315639 shutdown_connections 2023-08-10T10:29:36.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.581+0000 7f23cf958700 1 -- 172.21.15.161:0/3905315639 wait complete. 2023-08-10T10:29:36.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 Processor -- start 2023-08-10T10:29:36.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 -- start start 2023-08-10T10:29:36.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80cde10 0x7f23c80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 0x7f23c81e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81f3c60 con 0x7f23c80cb920 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806d2b0 con 0x7f23c80cde10 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.582+0000 7f23cf958700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81f33c0 con 0x7f23c815e5e0 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60882/0 (socket says 172.21.15.161:60882) 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 -- 172.21.15.161:0/2938269866 learned_addr learned my addr 172.21.15.161:0/2938269866 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:36.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23ccef3700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80cde10 0x7f23c80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cdef5700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 0x7f23c81e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 -- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 msgr2=0x7f23c81e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 0x7f23c81e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 -- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80cde10 msgr2=0x7f23c80c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80cde10 0x7f23c80c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 -- 172.21.15.161:0/2938269866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009550 con 0x7f23c80cb920 2023-08-10T10:29:36.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cdef5700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 0x7f23c81e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:36.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cd6f4700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23c80d0db0 tx=0x7f23b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800b660 con 0x7f23c80cb920 2023-08-10T10:29:36.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800b800 con 0x7f23c80cb920 2023-08-10T10:29:36.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800bbb0 con 0x7f23c80cb920 2023-08-10T10:29:36.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c81f36a0 con 0x7f23c80cb920 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.583+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c80adbd0 con 0x7f23c80cb920 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.584+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80ada30 con 0x7f23c80cb920 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.585+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23b800bd10 con 0x7f23c80cb920 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.585+0000 7f23bdffb700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 0x7f23ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.585+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23b808ae40 con 0x7f23c80cb920 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.585+0000 7f23ccef3700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 0x7f23ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.586+0000 7f23ccef3700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 0x7f23ac06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23c80caeb0 tx=0x7f23c4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.589+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f23c80ada30 con 0x7f23c80cb920 2023-08-10T10:29:36.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.777+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23c80ada30 con 0x7f23c80cb920 2023-08-10T10:29:36.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.777+0000 7f23bdffb700 1 -- 172.21.15.161:0/2938269866 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23c80ada30 con 0x7f23c80cb920 2023-08-10T10:29:36.779 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:36.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 msgr2=0x7f23ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 0x7f23ac06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23c80caeb0 tx=0x7f23c4007be0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 msgr2=0x7f23c806cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23c80d0db0 tx=0x7f23b8004750 comp rx=0 tx=0).stop 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 shutdown_connections 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23ac06ace0 0x7f23ac06d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815e5e0 0x7f23c81e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c80cb920 0x7f23c806cd70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 --2- 172.21.15.161:0/2938269866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80cde10 0x7f23c80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 >> 172.21.15.161:0/2938269866 conn(0x7f23c809a140 msgr2=0x7f23c806f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 shutdown_connections 2023-08-10T10:29:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.779+0000 7f23cf958700 1 -- 172.21.15.161:0/2938269866 wait complete. 2023-08-10T10:29:36.800 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T10:29:36.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-08-10T10:29:36.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.922+0000 7f9b100d3700 1 Processor -- start 2023-08-10T10:29:36.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.922+0000 7f9b100d3700 1 -- start start 2023-08-10T10:29:36.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b100d3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b100d3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 0x7f9b0806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b100d3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0806e8c0 con 0x7f9b0806e480 2023-08-10T10:29:36.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b100d3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080c5890 con 0x7f9b08154620 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b100d3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0815b290 con 0x7f9b08071d10 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0d66e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 0x7f9b0806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0de6f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0de6f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59692/0 (socket says 172.21.15.161:59692) 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0e670700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9b0806e480 0x7f9b0815a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39692/0 (socket says 172.21.15.161:39692) 2023-08-10T10:29:36.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0de6f700 1 -- 172.21.15.161:0/2662064498 learned_addr learned my addr 172.21.15.161:0/2662064498 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:36.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0d66e700 1 -- 172.21.15.161:0/2662064498 >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 msgr2=0x7f9b080717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:36.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0d66e700 1 --2- 172.21.15.161:0/2662064498 >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0d66e700 1 -- 172.21.15.161:0/2662064498 >> v1:172.21.15.175:6789/0 conn(0x7f9b0806e480 legacy=0x7f9b0815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0d66e700 1 -- 172.21.15.161:0/2662064498 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0815b570 con 0x7f9b08071d10 2023-08-10T10:29:36.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.923+0000 7f9b0de6f700 1 --2- 172.21.15.161:0/2662064498 >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:36.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b0d66e700 1 --2- 172.21.15.161:0/2662064498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 0x7f9b0806df40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009840 tx=0x7f9af8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d543fb116fc1a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b0ce6d700 1 -- 172.21.15.161:0/2662064498 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011830 con 0x7f9b08071d10 2023-08-10T10:29:36.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b0ce6d700 1 -- 172.21.15.161:0/2662064498 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8011990 con 0x7f9b08071d10 2023-08-10T10:29:36.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b0ce6d700 1 -- 172.21.15.161:0/2662064498 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011d20 con 0x7f9b08071d10 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 -- 172.21.15.161:0/2662064498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 msgr2=0x7f9b0806df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 --2- 172.21.15.161:0/2662064498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 0x7f9b0806df40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009840 tx=0x7f9af8009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 -- 172.21.15.161:0/2662064498 shutdown_connections 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 --2- 172.21.15.161:0/2662064498 >> v2:172.21.15.175:3300/0 conn(0x7f9b08154620 0x7f9b080717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 --2- 172.21.15.161:0/2662064498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b08071d10 0x7f9b0806df40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.924+0000 7f9b100d3700 1 -- 172.21.15.161:0/2662064498 >> 172.21.15.161:0/2662064498 conn(0x7f9b080cfd70 msgr2=0x7f9b080d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:36.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.925+0000 7f9b100d3700 1 -- 172.21.15.161:0/2662064498 shutdown_connections 2023-08-10T10:29:36.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.925+0000 7f9b100d3700 1 -- 172.21.15.161:0/2662064498 wait complete. 2023-08-10T10:29:36.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 Processor -- start 2023-08-10T10:29:36.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 -- start start 2023-08-10T10:29:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0806e480 0x7f9b08146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b08071d10 0x7f9b08140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.926+0000 7f9b100d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08140f90 con 0x7f9b08154620 2023-08-10T10:29:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b100d3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081450c0 con 0x7f9b08071d10 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b100d3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081453a0 con 0x7f9b0806e480 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60900/0 (socket says 172.21.15.161:60900) 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 -- 172.21.15.161:0/3014188396 learned_addr learned my addr 172.21.15.161:0/3014188396 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0d66e700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b08071d10 0x7f9b08140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0de6f700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0806e480 0x7f9b08146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 -- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0806e480 msgr2=0x7f9b08146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0806e480 0x7f9b08146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 -- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b08071d10 msgr2=0x7f9b08140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b08071d10 0x7f9b08140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 -- 172.21.15.161:0/3014188396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b04009550 con 0x7f9b08154620 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b0e670700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000cbd0 tx=0x7f9b0000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000abb0 con 0x7f9b08154620 2023-08-10T10:29:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000ad10 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af80094a0 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00007270 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.927+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b08145960 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.928+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b080744e0 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.929+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b000073d0 con 0x7f9b08154620 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.929+0000 7f9afe7fc700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.929+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b00089160 con 0x7f9b08154620 2023-08-10T10:29:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.929+0000 7f9b0de6f700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.929+0000 7f9b0de6f700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 0x7f9aec06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009c50 tx=0x7f9b04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:36.933+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9b00054350 con 0x7f9b08154620 2023-08-10T10:29:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.194+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9b080d07b0 con 0x7f9b08154620 2023-08-10T10:29:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.483+0000 7f9afe7fc700 1 -- 172.21.15.161:0/3014188396 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v55) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9b000170d0 con 0x7f9b08154620 2023-08-10T10:29:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.485+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 msgr2=0x7f9aec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.485+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 0x7f9aec06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009c50 tx=0x7f9b04008040 comp rx=0 tx=0).stop 2023-08-10T10:29:37.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.485+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 msgr2=0x7f9b08144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.485+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000cbd0 tx=0x7f9b0000cf90 comp rx=0 tx=0).stop 2023-08-10T10:29:37.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 shutdown_connections 2023-08-10T10:29:37.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b08154620 0x7f9b08144670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0806e480 0x7f9b08146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 --2- 172.21.15.161:0/3014188396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b08071d10 0x7f9b08140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 >> 172.21.15.161:0/3014188396 conn(0x7f9b080cfd70 msgr2=0x7f9b0815cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 shutdown_connections 2023-08-10T10:29:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.486+0000 7f9b100d3700 1 -- 172.21.15.161:0/3014188396 wait complete. 2023-08-10T10:29:37.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:37.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 Processor -- start 2023-08-10T10:29:37.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 -- start start 2023-08-10T10:29:37.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdb2c1597d0 0x7fdb2c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0cd820 con 0x7fdb2c06d2f0 2023-08-10T10:29:37.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2c0c9ca0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb31726700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2c070cc0 con 0x7fdb2c1597d0 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.619+0000 7fdb2a7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60906/0 (socket says 172.21.15.161:60906) 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/3994991240 learned_addr learned my addr 172.21.15.161:0/3994991240 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2affd700 1 --2- 172.21.15.161:0/3994991240 >> v2:172.21.15.175:3300/0 conn(0x7fdb2c1597d0 0x7fdb2c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/3994991240 >> v2:172.21.15.175:3300/0 conn(0x7fdb2c1597d0 msgr2=0x7fdb2c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 --2- 172.21.15.161:0/3994991240 >> v2:172.21.15.175:3300/0 conn(0x7fdb2c1597d0 0x7fdb2c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/3994991240 >> v1:172.21.15.175:6789/0 conn(0x7fdb2c06d2f0 legacy=0x7fdb2c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/3994991240 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0c9ef0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb2a7fc700 1 --2- 172.21.15.161:0/3994991240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c06e6f0 tx=0x7fdb1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11a5ce8af2d9e27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb29ffb700 1 -- 172.21.15.161:0/3994991240 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c00b870 con 0x7fdb2c0717c0 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb29ffb700 1 -- 172.21.15.161:0/3994991240 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c00b9d0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.620+0000 7fdb29ffb700 1 -- 172.21.15.161:0/3994991240 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c00bd60 con 0x7fdb2c0717c0 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 -- 172.21.15.161:0/3994991240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 msgr2=0x7fdb2c06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 --2- 172.21.15.161:0/3994991240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c06e6f0 tx=0x7fdb1c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 -- 172.21.15.161:0/3994991240 shutdown_connections 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 --2- 172.21.15.161:0/3994991240 >> v2:172.21.15.175:3300/0 conn(0x7fdb2c1597d0 0x7fdb2c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 --2- 172.21.15.161:0/3994991240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c06c7b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 -- 172.21.15.161:0/3994991240 >> 172.21.15.161:0/3994991240 conn(0x7fdb2c0cec40 msgr2=0x7fdb2c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 -- 172.21.15.161:0/3994991240 shutdown_connections 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.621+0000 7fdb31726700 1 -- 172.21.15.161:0/3994991240 wait complete. 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.622+0000 7fdb31726700 1 Processor -- start 2023-08-10T10:29:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.622+0000 7fdb31726700 1 -- start start 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb2c06d2f0 0x7fdb2c1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb2c1597d0 0x7fdb2c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c1f3f10 con 0x7fdb2c0717c0 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c14df90 con 0x7fdb2c06d2f0 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb31726700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c1f6570 con 0x7fdb2c1597d0 2023-08-10T10:29:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60912/0 (socket says 172.21.15.161:60912) 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/2487813436 learned_addr learned my addr 172.21.15.161:0/2487813436 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2affd700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb2c06d2f0 0x7fdb2c1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2b7fe700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb2c1597d0 0x7fdb2c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb2c1597d0 msgr2=0x7fdb2c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb2c1597d0 0x7fdb2c0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb2c06d2f0 msgr2=0x7fdb2c1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb2c06d2f0 0x7fdb2c1f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 -- 172.21.15.161:0/2487813436 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009550 con 0x7fdb2c0717c0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.623+0000 7fdb2a7fc700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c000c00 tx=0x7fdb1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.624+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c004480 con 0x7fdb2c0717c0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.624+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0045e0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.624+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0038e0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.624+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c150d60 con 0x7fdb2c0717c0 2023-08-10T10:29:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.624+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c14e4c0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.625+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c14e650 con 0x7fdb2c0717c0 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.625+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb1c021070 con 0x7fdb2c0717c0 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.625+0000 7fdb137fe700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 0x7fdb1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.625+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb1c08aad0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.625+0000 7fdb2affd700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 0x7fdb1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.626+0000 7fdb2affd700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 0x7fdb1806d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006b20 tx=0x7fdb20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.630+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdb1c055cb0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.818+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb2c1f66e0 con 0x7fdb2c0717c0 2023-08-10T10:29:37.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.819+0000 7fdb137fe700 1 -- 172.21.15.161:0/2487813436 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fdb1c015090 con 0x7fdb2c0717c0 2023-08-10T10:29:37.820 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:37.821 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:37.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 msgr2=0x7fdb1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 0x7fdb1806d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006b20 tx=0x7fdb20008040 comp rx=0 tx=0).stop 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 msgr2=0x7fdb2c0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c000c00 tx=0x7fdb1c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 shutdown_connections 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fdb1806ace0 0x7fdb1806d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb2c1597d0 0x7fdb2c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb2c06d2f0 0x7fdb2c1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 --2- 172.21.15.161:0/2487813436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb2c0717c0 0x7fdb2c0c7540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 >> 172.21.15.161:0/2487813436 conn(0x7fdb2c0cec40 msgr2=0x7fdb2c0b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:37.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 shutdown_connections 2023-08-10T10:29:37.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.821+0000 7fdb31726700 1 -- 172.21.15.161:0/2487813436 wait complete. 2023-08-10T10:29:37.835 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:37.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:37.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 Processor -- start 2023-08-10T10:29:37.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 -- start start 2023-08-10T10:29:37.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f824c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c071f60 con 0x7f824c15b380 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c072710 con 0x7f824c0ce6f0 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f825233c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c06a8a0 con 0x7f824c0cef20 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f824bfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f824c15b380 0x7f824c06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37924/0 (socket says 172.21.15.161:37924) 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.958+0000 7f824bfff700 1 -- 172.21.15.161:0/320689325 learned_addr learned my addr 172.21.15.161:0/320689325 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:37.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250623611 0 0) 0x7f824c071f60 con 0x7f824c15b380 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82340035b0 con 0x7f824c15b380 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824b7fe700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f824c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765046475 0 0) 0x7f82340035b0 con 0x7f824c15b380 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 msgr2=0x7f824c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f824c0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 >> v1:172.21.15.175:6789/0 conn(0x7f824c0ce6f0 legacy=0x7f824c15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c072190 con 0x7f824c15b380 2023-08-10T10:29:37.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f8240001670 con 0x7f824c15b380 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 >> v1:172.21.15.161:6789/0 conn(0x7f824c15b380 legacy=0x7f824c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8234003a30 0x7f8234003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82340043e0 0x7f82340048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f8234005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c06a8a0 con 0x7f8234003a30 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823400ba10 con 0x7f82340043e0 2023-08-10T10:29:37.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823400bbd0 con 0x7f824c0cef20 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8234003a30 0x7f8234003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824b7fe700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82340043e0 0x7f82340048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f82508d9700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f8234005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 -- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 msgr2=0x7f8234005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f8234005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 -- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82340043e0 msgr2=0x7f82340048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82340043e0 0x7f82340048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f824bfff700 1 -- 172.21.15.161:0/320689325 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340035b0 con 0x7f8234003a30 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.959+0000 7f82508d9700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0cef20 0x7f8234005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f824bfff700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8234003a30 0x7f8234003e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f824000c2f0 tx=0x7f8234005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1ddffeb442ddf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000ce30 con 0x7f8234003a30 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240005960 con 0x7f8234003a30 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f824affd700 1 -- 172.21.15.161:0/320689325 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8240005cf0 con 0x7f8234003a30 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 -- 172.21.15.161:0/320689325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8234003a30 msgr2=0x7f8234003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 --2- 172.21.15.161:0/320689325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8234003a30 0x7f8234003e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f824000c2f0 tx=0x7f8234005880 comp rx=0 tx=0).stop 2023-08-10T10:29:37.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f82508d9700 1 -- 172.21.15.161:0/320689325 reap_dead start 2023-08-10T10:29:37.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 -- 172.21.15.161:0/320689325 shutdown_connections 2023-08-10T10:29:37.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 -- 172.21.15.161:0/320689325 >> 172.21.15.161:0/320689325 conn(0x7f824c0cf4c0 msgr2=0x7f824c0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:37.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 -- 172.21.15.161:0/320689325 shutdown_connections 2023-08-10T10:29:37.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.960+0000 7f825233c700 1 -- 172.21.15.161:0/320689325 wait complete. 2023-08-10T10:29:37.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.961+0000 7f825233c700 1 Processor -- start 2023-08-10T10:29:37.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 -- start start 2023-08-10T10:29:37.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8234003a30 0x7f824c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 0x7f824c1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0cb9e0 con 0x7f824c0caff0 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0c9fa0 con 0x7f8234003a30 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.962+0000 7f825233c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0ca280 con 0x7f824c0c9b10 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60934/0 (socket says 172.21.15.161:60934) 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 -- 172.21.15.161:0/2020105287 learned_addr learned my addr 172.21.15.161:0/2020105287 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f824bfff700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8234003a30 0x7f824c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f824b7fe700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 0x7f824c1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 -- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 msgr2=0x7f824c1f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 0x7f824c1f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 -- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8234003a30 msgr2=0x7f824c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8234003a30 0x7f824c15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:37.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 -- 172.21.15.161:0/2020105287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0ca560 con 0x7f824c0caff0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f824b7fe700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 0x7f824c1f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f82508d9700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f82440015f0 tx=0x7f824400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244003c10 con 0x7f824c0caff0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244003d90 con 0x7f824c0caff0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244005310 con 0x7f824c0caff0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c0ca840 con 0x7f824c0caff0 2023-08-10T10:29:37.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.963+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c0c8330 con 0x7f824c0caff0 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.964+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c06a6c0 con 0x7f824c0caff0 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.965+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8244005470 con 0x7f824c0caff0 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.965+0000 7f8248ff9700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 0x7f823806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.965+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8244089280 con 0x7f824c0caff0 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.965+0000 7f824bfff700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 0x7f823806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:37.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.965+0000 7f824bfff700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 0x7f823806d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8240008fd0 tx=0x7f8240007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:37.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:37.969+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f82440543c0 con 0x7f824c0caff0 2023-08-10T10:29:38.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.155+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f824c072710 con 0x7f824c0caff0 2023-08-10T10:29:38.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.155+0000 7f8248ff9700 1 -- 172.21.15.161:0/2020105287 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f824c072710 con 0x7f824c0caff0 2023-08-10T10:29:38.157 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 msgr2=0x7f823806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 0x7f823806d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8240008fd0 tx=0x7f8240007000 comp rx=0 tx=0).stop 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 msgr2=0x7f824c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f82440015f0 tx=0x7f824400ee20 comp rx=0 tx=0).stop 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 shutdown_connections 2023-08-10T10:29:38.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f823806ace0 0x7f823806d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824c0caff0 0x7f824c0cb4a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8234003a30 0x7f824c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 --2- 172.21.15.161:0/2020105287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f824c0c9b10 0x7f824c1f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.157+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 >> 172.21.15.161:0/2020105287 conn(0x7f824c0cf4c0 msgr2=0x7f824c0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.158+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 shutdown_connections 2023-08-10T10:29:38.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.158+0000 7f825233c700 1 -- 172.21.15.161:0/2020105287 wait complete. 2023-08-10T10:29:38.171 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:38.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.293+0000 7f94b22f6700 1 Processor -- start 2023-08-10T10:29:38.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 -- start start 2023-08-10T10:29:38.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94ac0b2120 0x7f94ac0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94ac0cf730 0x7f94ac06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0b25b0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac071950 con 0x7f94ac0b2120 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94b22f6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac160b30 con 0x7f94ac0cf730 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94ab7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94ac0b2120 0x7f94ac0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94abfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f94ac0cb9f0 0x7f94ac160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37944/0 (socket says 172.21.15.161:37944) 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.294+0000 7f94abfff700 1 -- 172.21.15.161:0/1942702951 learned_addr learned my addr 172.21.15.161:0/1942702951 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94b0893700 1 --2- 172.21.15.161:0/1942702951 >> v2:172.21.15.175:3300/0 conn(0x7f94ac0cf730 0x7f94ac06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94aaffd700 1 -- 172.21.15.161:0/1942702951 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565976658 0 0) 0x7f94ac0b25b0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94aaffd700 1 -- 172.21.15.161:0/1942702951 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94940035b0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94ab7fe700 1 -- 172.21.15.161:0/1942702951 >> v2:172.21.15.175:3300/0 conn(0x7f94ac0cf730 msgr2=0x7f94ac06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94ab7fe700 1 --2- 172.21.15.161:0/1942702951 >> v2:172.21.15.175:3300/0 conn(0x7f94ac0cf730 0x7f94ac06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94ab7fe700 1 -- 172.21.15.161:0/1942702951 >> v1:172.21.15.161:6789/0 conn(0x7f94ac0cb9f0 legacy=0x7f94ac160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94ab7fe700 1 -- 172.21.15.161:0/1942702951 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac06dc10 con 0x7f94ac0b2120 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94ab7fe700 1 --2- 172.21.15.161:0/1942702951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0b2120 0x7f94ac0cf1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0af1a0 tx=0x7f949c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e6f2c618fecc82 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94aaffd700 1 -- 172.21.15.161:0/1942702951 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011830 con 0x7f94ac0b2120 2023-08-10T10:29:38.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94aaffd700 1 -- 172.21.15.161:0/1942702951 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c011990 con 0x7f94ac0b2120 2023-08-10T10:29:38.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.295+0000 7f94aaffd700 1 -- 172.21.15.161:0/1942702951 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011d20 con 0x7f94ac0b2120 2023-08-10T10:29:38.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 -- 172.21.15.161:0/1942702951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0b2120 msgr2=0x7f94ac0cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 --2- 172.21.15.161:0/1942702951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0b2120 0x7f94ac0cf1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0af1a0 tx=0x7f949c009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:38.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 -- 172.21.15.161:0/1942702951 shutdown_connections 2023-08-10T10:29:38.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 --2- 172.21.15.161:0/1942702951 >> v2:172.21.15.175:3300/0 conn(0x7f94ac0cf730 0x7f94ac06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 --2- 172.21.15.161:0/1942702951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0b2120 0x7f94ac0cf1f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 -- 172.21.15.161:0/1942702951 >> 172.21.15.161:0/1942702951 conn(0x7f94ac0cc740 msgr2=0x7f94ac0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 -- 172.21.15.161:0/1942702951 shutdown_connections 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.296+0000 7f94b22f6700 1 -- 172.21.15.161:0/1942702951 wait complete. 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.297+0000 7f94b22f6700 1 Processor -- start 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.297+0000 7f94b22f6700 1 -- start start 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 0x7f94ac159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ac0cf730 0x7f94ac0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac15aa30 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b1230 con 0x7f94ac0cf730 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b22f6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b0620 con 0x7f94ac0b2120 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60946/0 (socket says 172.21.15.161:60946) 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 -- 172.21.15.161:0/3572432740 learned_addr learned my addr 172.21.15.161:0/3572432740 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:38.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94b0893700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ac0cf730 0x7f94ac0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94abfff700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 0x7f94ac159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 -- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 msgr2=0x7f94ac159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 0x7f94ac159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 -- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ac0cf730 msgr2=0x7f94ac0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ac0cf730 0x7f94ac0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 -- 172.21.15.161:0/3572432740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0094a0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94abfff700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 0x7f94ac159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94ab7fe700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f949c0097c0 tx=0x7f949c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0036a0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.298+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c01e070 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.299+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0b0900 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.299+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c003a60 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.299+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0b0ec0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.300+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac0b13c0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.300+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f949c003bc0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.300+0000 7f94a8ff9700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.300+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f949c08a250 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.301+0000 7f94abfff700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.301+0000 7f94abfff700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94a00011e0 tx=0x7f94a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.305+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f949c055390 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.496+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94ac04ecc0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.496+0000 7f94a8ff9700 1 -- 172.21.15.161:0/3572432740 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f949c0589b0 con 0x7f94ac0cb9f0 2023-08-10T10:29:38.498 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:38.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 msgr2=0x7f949806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94a00011e0 tx=0x7f94a0009040 comp rx=0 tx=0).stop 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 msgr2=0x7f94ac0b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f949c0097c0 tx=0x7f949c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 shutdown_connections 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f949806ace0 0x7f949806d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ac0cf730 0x7f94ac0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ac0b2120 0x7f94ac159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 --2- 172.21.15.161:0/3572432740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ac0cb9f0 0x7f94ac0b3ec0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.498+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 >> 172.21.15.161:0/3572432740 conn(0x7f94ac0cc740 msgr2=0x7f94ac0ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.499+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 shutdown_connections 2023-08-10T10:29:38.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.499+0000 7f94b22f6700 1 -- 172.21.15.161:0/3572432740 wait complete. 2023-08-10T10:29:38.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:38.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.635+0000 7ff8963fa700 1 Processor -- start 2023-08-10T10:29:38.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.635+0000 7ff8963fa700 1 -- start start 2023-08-10T10:29:38.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff8963fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8900cfa30 0x7ff8900cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff8963fa700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8900cdc40 0x7ff8900b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff8963fa700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89015e9c0 con 0x7ff89015e5e0 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff8963fa700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900ce0d0 con 0x7ff8900cdc40 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff8963fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900cc1c0 con 0x7ff8900cfa30 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8900cdc40 0x7ff8900b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8900cdc40 0x7ff8900b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60956/0 (socket says 172.21.15.161:60956) 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 -- 172.21.15.161:0/2760297136 learned_addr learned my addr 172.21.15.161:0/2760297136 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:38.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff88f7fe700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8900cfa30 0x7ff8900cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 -- 172.21.15.161:0/2760297136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8900cfa30 msgr2=0x7ff8900cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8900cfa30 0x7ff8900cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 -- 172.21.15.161:0/2760297136 >> v1:172.21.15.175:6789/0 conn(0x7ff89015e5e0 legacy=0x7ff8900cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 -- 172.21.15.161:0/2760297136 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900cc4a0 con 0x7ff8900cdc40 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.636+0000 7ff894997700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff8900b0940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff888009e50 tx=0x7ff88800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7f81a5da36e1ba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff88effd700 1 -- 172.21.15.161:0/2760297136 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800e070 con 0x7ff8900cdc40 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff88effd700 1 -- 172.21.15.161:0/2760297136 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88800b910 con 0x7ff8900cdc40 2023-08-10T10:29:38.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff88effd700 1 -- 172.21.15.161:0/2760297136 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800bcc0 con 0x7ff8900cdc40 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 -- 172.21.15.161:0/2760297136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 msgr2=0x7ff8900b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff8900b0940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff888009e50 tx=0x7ff88800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 -- 172.21.15.161:0/2760297136 shutdown_connections 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff8900b0940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 --2- 172.21.15.161:0/2760297136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8900cfa30 0x7ff8900cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 -- 172.21.15.161:0/2760297136 >> 172.21.15.161:0/2760297136 conn(0x7ff89009a140 msgr2=0x7ff8900d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 -- 172.21.15.161:0/2760297136 shutdown_connections 2023-08-10T10:29:38.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.637+0000 7ff8963fa700 1 -- 172.21.15.161:0/2760297136 wait complete. 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.638+0000 7ff8963fa700 1 Processor -- start 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 -- start start 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 0x7ff8900c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 0x7ff8900ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c5d00 con 0x7ff8900cdc40 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c5fe0 con 0x7ff8900cfa30 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff8963fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c62c0 con 0x7ff89015e5e0 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60958/0 (socket says 172.21.15.161:60958) 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.639+0000 7ff88ffff700 1 -- 172.21.15.161:0/3295295376 learned_addr learned my addr 172.21.15.161:0/3295295376 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88f7fe700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 0x7ff8900c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff894997700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 0x7ff8900ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 -- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 msgr2=0x7ff8900ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 0x7ff8900ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 -- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 msgr2=0x7ff8900c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 0x7ff8900c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 -- 172.21.15.161:0/3295295376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff888009b30 con 0x7ff8900cdc40 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88f7fe700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 0x7ff8900c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff894997700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 0x7ff8900ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:38.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88ffff700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c4e0 tx=0x7ff88400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840052d0 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff884005430 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900c65a0 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840038c0 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.640+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8900c79f0 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.641+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8900c7c10 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.641+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff884003a20 con 0x7ff8900cdc40 2023-08-10T10:29:38.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.642+0000 7ff88cff9700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 0x7ff87c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.642+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8840889a0 con 0x7ff8900cdc40 2023-08-10T10:29:38.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.642+0000 7ff88f7fe700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 0x7ff87c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.642+0000 7ff88f7fe700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 0x7ff87c06d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8900b6c30 tx=0x7ff880008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.646+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff884053a50 con 0x7ff8900cdc40 2023-08-10T10:29:38.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.832+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff89004ecc0 con 0x7ff8900cdc40 2023-08-10T10:29:38.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.833+0000 7ff88cff9700 1 -- 172.21.15.161:0/3295295376 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff884057070 con 0x7ff8900cdc40 2023-08-10T10:29:38.835 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:38.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 msgr2=0x7ff87c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 0x7ff87c06d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8900b6c30 tx=0x7ff880008040 comp rx=0 tx=0).stop 2023-08-10T10:29:38.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 msgr2=0x7ff89009e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c4e0 tx=0x7ff88400c8a0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 shutdown_connections 2023-08-10T10:29:38.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff87c06ace0 0x7ff87c06d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff89015e5e0 0x7ff8900ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900cdc40 0x7ff89009e6f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 --2- 172.21.15.161:0/3295295376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8900cfa30 0x7ff8900c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 >> 172.21.15.161:0/3295295376 conn(0x7ff89009a140 msgr2=0x7ff8900d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 shutdown_connections 2023-08-10T10:29:38.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.835+0000 7ff8963fa700 1 -- 172.21.15.161:0/3295295376 wait complete. 2023-08-10T10:29:38.849 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.971+0000 7f199d924700 1 Processor -- start 2023-08-10T10:29:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.971+0000 7f199d924700 1 -- start start 2023-08-10T10:29:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f199d924700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19981609d0 0x7f19980d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f199d924700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19980d0ed0 0x7f19980d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f199d924700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19980b0c10 con 0x7f19980d1b60 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f199d924700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980b22f0 con 0x7f19980d0ed0 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f199d924700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980d1ff0 con 0x7f19981609d0 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19980d0ed0 0x7f19980d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19977fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f19980d1b60 0x7f1998160f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37974/0 (socket says 172.21.15.161:37974) 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19977fe700 1 -- 172.21.15.161:0/1550088236 learned_addr learned my addr 172.21.15.161:0/1550088236 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 --2- 172.21.15.161:0/1550088236 >> v2:172.21.15.161:3300/0 conn(0x7f19980d0ed0 0x7f19980d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60970/0 (socket says 172.21.15.161:60970) 2023-08-10T10:29:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f1996ffd700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19981609d0 0x7f19980d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 -- 172.21.15.161:0/1550088236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19981609d0 msgr2=0x7f19980d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19981609d0 0x7f19980d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 -- 172.21.15.161:0/1550088236 >> v1:172.21.15.161:6789/0 conn(0x7f19980d1b60 legacy=0x7f1998160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f1995ffb700 1 -- 172.21.15.161:0/1550088236 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512296370 0 0) 0x7f19980b0c10 con 0x7f19980d1b60 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.972+0000 7f19967fc700 1 -- 172.21.15.161:0/1550088236 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19980cddf0 con 0x7f19980d0ed0 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f19967fc700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d0ed0 0x7f19980d1620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1988009840 tx=0x7f1988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f5be4c616de9bc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f1995ffb700 1 -- 172.21.15.161:0/1550088236 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011830 con 0x7f19980d0ed0 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f1995ffb700 1 -- 172.21.15.161:0/1550088236 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988011990 con 0x7f19980d0ed0 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f1995ffb700 1 -- 172.21.15.161:0/1550088236 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011d20 con 0x7f19980d0ed0 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 -- 172.21.15.161:0/1550088236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d0ed0 msgr2=0x7f19980d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d0ed0 0x7f19980d1620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1988009840 tx=0x7f1988009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 -- 172.21.15.161:0/1550088236 shutdown_connections 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19981609d0 0x7f19980d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 --2- 172.21.15.161:0/1550088236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d0ed0 0x7f19980d1620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 -- 172.21.15.161:0/1550088236 >> 172.21.15.161:0/1550088236 conn(0x7f19980d3040 msgr2=0x7f19980d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:38.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 -- 172.21.15.161:0/1550088236 shutdown_connections 2023-08-10T10:29:38.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.973+0000 7f199d924700 1 -- 172.21.15.161:0/1550088236 wait complete. 2023-08-10T10:29:38.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.974+0000 7f199d924700 1 Processor -- start 2023-08-10T10:29:38.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 -- start start 2023-08-10T10:29:38.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 0x7f199815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 0x7f19980b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199815bc50 con 0x7f19980d1b60 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981f5fb0 con 0x7f19981609d0 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.975+0000 7f199d924700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980b42f0 con 0x7f19980d0ed0 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60972/0 (socket says 172.21.15.161:60972) 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 -- 172.21.15.161:0/1560565077 learned_addr learned my addr 172.21.15.161:0/1560565077 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:38.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 -- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 msgr2=0x7f199815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19977fe700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 0x7f19980b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f1996ffd700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 0x7f199815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 0x7f199815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 -- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 msgr2=0x7f19980b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 0x7f19980b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 -- 172.21.15.161:0/1560565077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880094a0 con 0x7f19980d1b60 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19977fe700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 0x7f19980b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:38.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f1996ffd700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 0x7f199815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f19967fc700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1988014040 tx=0x7f1988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880045f0 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198801e070 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19981f6200 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988003b00 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.976+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19981f67c0 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.977+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19981f69b0 con 0x7f19980d1b60 2023-08-10T10:29:38.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.978+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1988003c60 con 0x7f19980d1b60 2023-08-10T10:29:38.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.978+0000 7f197ffff700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 0x7f198406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:38.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.978+0000 7f1996ffd700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 0x7f198406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:38.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.978+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f198808a5f0 con 0x7f19980d1b60 2023-08-10T10:29:38.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.978+0000 7f1996ffd700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 0x7f198406d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19980ca040 tx=0x7f198c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:38.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:38.982+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1988055730 con 0x7f19980d1b60 2023-08-10T10:29:39.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.170+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f199804ecc0 con 0x7f19980d1b60 2023-08-10T10:29:39.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.170+0000 7f197ffff700 1 -- 172.21.15.161:0/1560565077 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1988058d50 con 0x7f19980d1b60 2023-08-10T10:29:39.172 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 msgr2=0x7f198406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 0x7f198406d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19980ca040 tx=0x7f198c008040 comp rx=0 tx=0).stop 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 msgr2=0x7f199815f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1988014040 tx=0x7f1988004750 comp rx=0 tx=0).stop 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 shutdown_connections 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f198406ace0 0x7f198406d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19981609d0 0x7f19980b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19980d0ed0 0x7f199815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 --2- 172.21.15.161:0/1560565077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19980d1b60 0x7f199815f7e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.172+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 >> 172.21.15.161:0/1560565077 conn(0x7f19980d3040 msgr2=0x7f199806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:39.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.173+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 shutdown_connections 2023-08-10T10:29:39.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.173+0000 7f199d924700 1 -- 172.21.15.161:0/1560565077 wait complete. 2023-08-10T10:29:39.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:29:39.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.307+0000 7f2414a32700 1 Processor -- start 2023-08-10T10:29:39.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.307+0000 7f2414a32700 1 -- start start 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.308+0000 7f2414a32700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f241006a190 0x7f241006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.308+0000 7f2414a32700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241006aae0 con 0x7f24100b2120 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.308+0000 7f2414a32700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100b25b0 con 0x7f24100cb9f0 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.308+0000 7f2414a32700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2410071950 con 0x7f241006a190 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.308+0000 7f240ed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f241006a190 0x7f241006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f241006a190 0x7f241006a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60984/0 (socket says 172.21.15.161:60984) 2023-08-10T10:29:39.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240dd9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f24100b2120 0x7f24100cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37988/0 (socket says 172.21.15.161:37988) 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 -- 172.21.15.161:0/859021993 learned_addr learned my addr 172.21.15.161:0/859021993 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 -- 172.21.15.161:0/859021993 >> v1:172.21.15.175:6789/0 conn(0x7f24100cb9f0 legacy=0x7f2410160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 -- 172.21.15.161:0/859021993 >> v1:172.21.15.161:6789/0 conn(0x7f24100b2120 legacy=0x7f24100cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 -- 172.21.15.161:0/859021993 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241006dc10 con 0x7f241006a190 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240ed9d700 1 --2- 172.21.15.161:0/859021993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241006a190 0x7f241006a5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2408009e50 tx=0x7f240800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7043424d5e608e4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240d59a700 1 -- 172.21.15.161:0/859021993 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800e070 con 0x7f241006a190 2023-08-10T10:29:39.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240d59a700 1 -- 172.21.15.161:0/859021993 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800b9c0 con 0x7f241006a190 2023-08-10T10:29:39.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.309+0000 7f240d59a700 1 -- 172.21.15.161:0/859021993 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800bd70 con 0x7f241006a190 2023-08-10T10:29:39.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 -- 172.21.15.161:0/859021993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241006a190 msgr2=0x7f241006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 --2- 172.21.15.161:0/859021993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241006a190 0x7f241006a5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2408009e50 tx=0x7f240800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:39.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 -- 172.21.15.161:0/859021993 shutdown_connections 2023-08-10T10:29:39.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 --2- 172.21.15.161:0/859021993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241006a190 0x7f241006a5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 -- 172.21.15.161:0/859021993 >> 172.21.15.161:0/859021993 conn(0x7f24100cc740 msgr2=0x7f24100ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:39.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 -- 172.21.15.161:0/859021993 shutdown_connections 2023-08-10T10:29:39.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.310+0000 7f2414a32700 1 -- 172.21.15.161:0/859021993 wait complete. 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.311+0000 7f2414a32700 1 Processor -- start 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.311+0000 7f2414a32700 1 -- start start 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241006a190 0x7f241015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24100cb9f0 0x7f24100cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241015e810 con 0x7f24100b2120 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24100b4bd0 con 0x7f24100cb9f0 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f2414a32700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100b4eb0 con 0x7f241006a190 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60988/0 (socket says 172.21.15.161:60988) 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 -- 172.21.15.161:0/4279798940 learned_addr learned my addr 172.21.15.161:0/4279798940 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240e59c700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241006a190 0x7f241015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240ed9d700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24100cb9f0 0x7f24100cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 -- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241006a190 msgr2=0x7f241015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241006a190 0x7f241015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 -- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24100cb9f0 msgr2=0x7f24100cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24100cb9f0 0x7f24100cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 -- 172.21.15.161:0/4279798940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408009b30 con 0x7f24100b2120 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.312+0000 7f240dd9b700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f240000c500 tx=0x7f240000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.313+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400005cb0 con 0x7f24100b2120 2023-08-10T10:29:39.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.313+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2400005e10 con 0x7f24100b2120 2023-08-10T10:29:39.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.313+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24100b5190 con 0x7f24100b2120 2023-08-10T10:29:39.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.313+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000072d0 con 0x7f24100b2120 2023-08-10T10:29:39.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.313+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24100b48e0 con 0x7f24100b2120 2023-08-10T10:29:39.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.314+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24100b56b0 con 0x7f24100b2120 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.314+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2400007430 con 0x7f24100b2120 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.315+0000 7f23feffd700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 0x7f23f006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.315+0000 7f240e59c700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 0x7f23f006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.315+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2400088600 con 0x7f24100b2120 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.315+0000 7f240e59c700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 0x7f23f006d1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2404007fd0 tx=0x7f2404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.319+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f24100b56b0 con 0x7f24100b2120 2023-08-10T10:29:39.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.508+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f24100b56b0 con 0x7f24100b2120 2023-08-10T10:29:39.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.512+0000 7f23feffd700 1 -- 172.21.15.161:0/4279798940 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f24100b56b0 con 0x7f24100b2120 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 msgr2=0x7f23f006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 0x7f23f006d1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2404007fd0 tx=0x7f2404009040 comp rx=0 tx=0).stop 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 msgr2=0x7f24100c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f240000c500 tx=0x7f240000c810 comp rx=0 tx=0).stop 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 shutdown_connections 2023-08-10T10:29:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f23f006ad10 0x7f23f006d1d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24100cb9f0 0x7f24100cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241006a190 0x7f241015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 --2- 172.21.15.161:0/4279798940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24100b2120 0x7f24100c9410 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 >> 172.21.15.161:0/4279798940 conn(0x7f24100cc740 msgr2=0x7f24100d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 shutdown_connections 2023-08-10T10:29:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.514+0000 7f2414a32700 1 -- 172.21.15.161:0/4279798940 wait complete. 2023-08-10T10:29:39.527 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:29:39.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:29:39.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:29:39.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:29:39.617 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:39.618 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:39.635 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:39.635 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:39.692 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:39.692 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:39.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.907+0000 7f93736c3700 1 Processor -- start 2023-08-10T10:29:39.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.907+0000 7f93736c3700 1 -- start start 2023-08-10T10:29:39.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 0x7f936c0d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f936c0d1a40 0x7f936c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0cdd20 0x7f936c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0ccd40 con 0x7f936c0d1a40 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0ce130 con 0x7f936c15b050 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f93736c3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0cc780 con 0x7f936c0cdd20 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f9370c5e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f936c0d1a40 0x7f936c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f9370c5e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f936c0d1a40 0x7f936c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60994/0 (socket says 172.21.15.161:60994) 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.908+0000 7f9370c5e700 1 -- 172.21.15.161:0/38787544 learned_addr learned my addr 172.21.15.161:0/38787544 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 -- 172.21.15.161:0/38787544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0cdd20 msgr2=0x7f936c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 --2- 172.21.15.161:0/38787544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0cdd20 0x7f936c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f937145f700 1 --2- 172.21.15.161:0/38787544 >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 0x7f936c0d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 -- 172.21.15.161:0/38787544 >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 msgr2=0x7f936c0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 --2- 172.21.15.161:0/38787544 >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 0x7f936c0d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 -- 172.21.15.161:0/38787544 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0cca60 con 0x7f936c0d1a40 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f937145f700 1 --2- 172.21.15.161:0/38787544 >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 0x7f936c0d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9370c5e700 1 --2- 172.21.15.161:0/38787544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0d1a40 0x7f936c0cd7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f936c09a880 tx=0x7f9368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4157aa80bfc3279 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9363fff700 1 -- 172.21.15.161:0/38787544 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800b870 con 0x7f936c0d1a40 2023-08-10T10:29:39.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9363fff700 1 -- 172.21.15.161:0/38787544 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b9d0 con 0x7f936c0d1a40 2023-08-10T10:29:39.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.909+0000 7f9363fff700 1 -- 172.21.15.161:0/38787544 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bd60 con 0x7f936c0d1a40 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 -- 172.21.15.161:0/38787544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0d1a40 msgr2=0x7f936c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 --2- 172.21.15.161:0/38787544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0d1a40 0x7f936c0cd7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f936c09a880 tx=0x7f9368009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 -- 172.21.15.161:0/38787544 shutdown_connections 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 --2- 172.21.15.161:0/38787544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0cdd20 0x7f936c0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 --2- 172.21.15.161:0/38787544 >> v2:172.21.15.175:3300/0 conn(0x7f936c15b050 0x7f936c0d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 --2- 172.21.15.161:0/38787544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0d1a40 0x7f936c0cd7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 -- 172.21.15.161:0/38787544 >> 172.21.15.161:0/38787544 conn(0x7f936c09a150 msgr2=0x7f936c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 -- 172.21.15.161:0/38787544 shutdown_connections 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.910+0000 7f93736c3700 1 -- 172.21.15.161:0/38787544 wait complete. 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.911+0000 7f93736c3700 1 Processor -- start 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.911+0000 7f93736c3700 1 -- start start 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0d1a40 0x7f936c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 0x7f936c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0c8060 con 0x7f936c0cdd20 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c157090 con 0x7f936c15b050 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c157370 con 0x7f936c0d1a40 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32768/0 (socket says 172.21.15.161:32768) 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 -- 172.21.15.161:0/1987858419 learned_addr learned my addr 172.21.15.161:0/1987858419 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9370c5e700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0d1a40 0x7f936c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 -- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0d1a40 msgr2=0x7f936c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9371c60700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 0x7f936c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0d1a40 0x7f936c1566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 -- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 msgr2=0x7f936c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 0x7f936c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 -- 172.21.15.161:0/1987858419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368009550 con 0x7f936c0cdd20 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9371c60700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 0x7f936c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:39.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f937145f700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c7f0 tx=0x7f935c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c005c20 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c005d80 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c157650 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.912+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c011820 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.913+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c15cc60 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.914+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c0744e0 con 0x7f936c0cdd20 2023-08-10T10:29:39.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.914+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f935c011980 con 0x7f936c0cdd20 2023-08-10T10:29:39.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.914+0000 7f9361ffb700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 0x7f935006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:39.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.914+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f935c089710 con 0x7f936c0cdd20 2023-08-10T10:29:39.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.914+0000 7f9370c5e700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 0x7f935006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:39.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.915+0000 7f9370c5e700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 0x7f935006d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f936c09a880 tx=0x7f9368008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:39.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:39.918+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f935c054850 con 0x7f936c0cdd20 2023-08-10T10:29:40.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.106+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936c0cfae0 con 0x7f936c0cdd20 2023-08-10T10:29:40.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.107+0000 7f9361ffb700 1 -- 172.21.15.161:0/1987858419 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f935c057e70 con 0x7f936c0cdd20 2023-08-10T10:29:40.109 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:40.109 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 msgr2=0x7f935006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 0x7f935006d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f936c09a880 tx=0x7f9368008030 comp rx=0 tx=0).stop 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 msgr2=0x7f936c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c7f0 tx=0x7f935c00cbb0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 shutdown_connections 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f935006ace0 0x7f935006d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f936c15b050 0x7f936c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f936c0cdd20 0x7f936c15d400 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 --2- 172.21.15.161:0/1987858419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f936c0d1a40 0x7f936c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 >> 172.21.15.161:0/1987858419 conn(0x7f936c09a150 msgr2=0x7f936c06f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 shutdown_connections 2023-08-10T10:29:40.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.109+0000 7f93736c3700 1 -- 172.21.15.161:0/1987858419 wait complete. 2023-08-10T10:29:40.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:40.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:40.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.246+0000 7f3830087700 1 Processor -- start 2023-08-10T10:29:40.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.246+0000 7f3830087700 1 -- start start 2023-08-10T10:29:40.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f3830087700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f382815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f3830087700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382815abb0 con 0x7f38280b1740 2023-08-10T10:29:40.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f3830087700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382815ae90 con 0x7f382815a3b0 2023-08-10T10:29:40.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f3830087700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382815b170 con 0x7f3828159fd0 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f382e624700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f38280b1740 0x7f38280cb1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38016/0 (socket says 172.21.15.161:38016) 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f382e624700 1 -- 172.21.15.161:0/664146047 learned_addr learned my addr 172.21.15.161:0/664146047 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f382de23700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f382815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217579417 0 0) 0x7f382815abb0 con 0x7f38280b1740 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.247+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38140035b0 con 0x7f38280b1740 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343389781 0 0) 0x7f38140035b0 con 0x7f38280b1740 2023-08-10T10:29:40.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 msgr2=0x7f382815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f382815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 >> v1:172.21.15.175:6789/0 conn(0x7f382815a3b0 legacy=0x7f38280cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280cac90 con 0x7f38280b1740 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f38200019f0 con 0x7f38280b1740 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 >> v1:172.21.15.161:6789/0 conn(0x7f38280b1740 legacy=0x7f38280cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3814003a30 0x7f3814003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f3814004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3814005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382815b170 con 0x7f3814004d90 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381400ba10 con 0x7f3814003a30 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381400bbd0 con 0x7f3828159fd0 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3814005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382de23700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3814003a30 0x7f3814003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382d622700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f3814004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 -- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 msgr2=0x7f3814004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:40.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3828159fd0 0x7f3814004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 -- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3814003a30 msgr2=0x7f3814003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3814003a30 0x7f3814003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 -- 172.21.15.161:0/664146047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140035b0 con 0x7f3814004d90 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.248+0000 7f382e624700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3814005210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f382000a830 tx=0x7f3814005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10193997900839 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820012600 con 0x7f3814004d90 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820012780 con 0x7f3814004d90 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f382ce21700 1 -- 172.21.15.161:0/664146047 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820012b30 con 0x7f3814004d90 2023-08-10T10:29:40.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 -- 172.21.15.161:0/664146047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 msgr2=0x7f3814005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 --2- 172.21.15.161:0/664146047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3814005210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f382000a830 tx=0x7f3814005880 comp rx=0 tx=0).stop 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f382e624700 1 -- 172.21.15.161:0/664146047 reap_dead start 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 -- 172.21.15.161:0/664146047 shutdown_connections 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 -- 172.21.15.161:0/664146047 >> 172.21.15.161:0/664146047 conn(0x7f38280cc740 msgr2=0x7f38280ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 -- 172.21.15.161:0/664146047 shutdown_connections 2023-08-10T10:29:40.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.249+0000 7f3830087700 1 -- 172.21.15.161:0/664146047 wait complete. 2023-08-10T10:29:40.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.250+0000 7f3830087700 1 Processor -- start 2023-08-10T10:29:40.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.250+0000 7f3830087700 1 -- start start 2023-08-10T10:29:40.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281578a0 0x7f38280b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38280b4cc0 0x7f38280b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280b5690 con 0x7f3814004d90 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280b2c50 con 0x7f38281578a0 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f3830087700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280b2f30 con 0x7f38280b4cc0 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382de23700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382de23700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32786/0 (socket says 172.21.15.161:32786) 2023-08-10T10:29:40.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382de23700 1 -- 172.21.15.161:0/3208153413 learned_addr learned my addr 172.21.15.161:0/3208153413 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382e624700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38280b4cc0 0x7f38280b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382d622700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281578a0 0x7f38280b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.251+0000 7f382de23700 1 -- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38280b4cc0 msgr2=0x7f38280b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f382de23700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38280b4cc0 0x7f38280b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f382de23700 1 -- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281578a0 msgr2=0x7f38280b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f382de23700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281578a0 0x7f38280b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f382de23700 1 -- 172.21.15.161:0/3208153413 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280b3210 con 0x7f3814004d90 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f382de23700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3818011aa0 tx=0x7f3818011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800f980 con 0x7f3814004d90 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800fae0 con 0x7f3814004d90 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38280b34f0 con 0x7f3814004d90 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38280b28b0 con 0x7f3814004d90 2023-08-10T10:29:40.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.252+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800fe90 con 0x7f3814004d90 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.253+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382804ecc0 con 0x7f3814004d90 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.253+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f381801d400 con 0x7f3814004d90 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.254+0000 7f381e7fc700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 0x7f380c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.254+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3818089bb0 con 0x7f3814004d90 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.254+0000 7f382d622700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 0x7f380c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.254+0000 7f382d622700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 0x7f380c06d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3824007fd0 tx=0x7f3824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.258+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3818058840 con 0x7f3814004d90 2023-08-10T10:29:40.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.444+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38281598e0 con 0x7f3814004d90 2023-08-10T10:29:40.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.445+0000 7f381e7fc700 1 -- 172.21.15.161:0/3208153413 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38180583d0 con 0x7f3814004d90 2023-08-10T10:29:40.446 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:40.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 msgr2=0x7f380c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 0x7f380c06d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3824007fd0 tx=0x7f3824009040 comp rx=0 tx=0).stop 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 msgr2=0x7f3828149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3818011aa0 tx=0x7f3818011e60 comp rx=0 tx=0).stop 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 shutdown_connections 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f380c06ace0 0x7f380c06d1a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38280b4cc0 0x7f38280b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3814004d90 0x7f3828149060 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 --2- 172.21.15.161:0/3208153413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281578a0 0x7f38280b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 >> 172.21.15.161:0/3208153413 conn(0x7f38280cc740 msgr2=0x7f38280cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 shutdown_connections 2023-08-10T10:29:40.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.447+0000 7f3830087700 1 -- 172.21.15.161:0/3208153413 wait complete. 2023-08-10T10:29:40.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:40.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.585+0000 7f5503aa3700 1 Processor -- start 2023-08-10T10:29:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.585+0000 7f5503aa3700 1 -- start start 2023-08-10T10:29:40.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5503aa3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5503aa3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54fc071a00 0x7f54fc15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5503aa3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0c9850 con 0x7f54fc15af40 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5503aa3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc070510 con 0x7f54fc071a00 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5503aa3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0ca8f0 con 0x7f54fc0c9fd0 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5502040700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54fc071a00 0x7f54fc15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5502040700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54fc071a00 0x7f54fc15e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32798/0 (socket says 172.21.15.161:32798) 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.586+0000 7f5502040700 1 -- 172.21.15.161:0/3956102484 learned_addr learned my addr 172.21.15.161:0/3956102484 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:40.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f550183f700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f5502040700 1 -- 172.21.15.161:0/3956102484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 msgr2=0x7f54fc0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f5502040700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f5502040700 1 -- 172.21.15.161:0/3956102484 >> v1:172.21.15.175:6789/0 conn(0x7f54fc15af40 legacy=0x7f54fc15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f5502040700 1 -- 172.21.15.161:0/3956102484 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0c9570 con 0x7f54fc071a00 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f550183f700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f5502040700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc071a00 0x7f54fc15e200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4d94359747eb0d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f550083d700 1 -- 172.21.15.161:0/3956102484 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400e070 con 0x7f54fc071a00 2023-08-10T10:29:40.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f550083d700 1 -- 172.21.15.161:0/3956102484 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f400b9c0 con 0x7f54fc071a00 2023-08-10T10:29:40.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.587+0000 7f550083d700 1 -- 172.21.15.161:0/3956102484 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400bd70 con 0x7f54fc071a00 2023-08-10T10:29:40.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 -- 172.21.15.161:0/3956102484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc071a00 msgr2=0x7f54fc15e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc071a00 0x7f54fc15e200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:40.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 -- 172.21.15.161:0/3956102484 shutdown_connections 2023-08-10T10:29:40.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc071a00 0x7f54fc15e200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3956102484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 -- 172.21.15.161:0/3956102484 >> 172.21.15.161:0/3956102484 conn(0x7f54fc06a190 msgr2=0x7f54fc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 -- 172.21.15.161:0/3956102484 shutdown_connections 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.588+0000 7f5503aa3700 1 -- 172.21.15.161:0/3956102484 wait complete. 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.589+0000 7f5503aa3700 1 Processor -- start 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.589+0000 7f5503aa3700 1 -- start start 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 0x7f54fc14e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0b0480 con 0x7f54fc15af40 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0ae940 con 0x7f54fc071a00 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc14e5a0 con 0x7f54fc0c9fd0 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32804/0 (socket says 172.21.15.161:32804) 2023-08-10T10:29:40.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 -- 172.21.15.161:0/3801376837 learned_addr learned my addr 172.21.15.161:0/3801376837 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f550183f700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 0x7f54fc14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f550103e700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 -- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 msgr2=0x7f54fc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 -- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 msgr2=0x7f54fc14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 0x7f54fc14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 -- 172.21.15.161:0/3801376837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009b30 con 0x7f54fc15af40 2023-08-10T10:29:40.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f550183f700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 0x7f54fc14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5502040700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b730 tx=0x7f54f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40099b0 con 0x7f54fc15af40 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40092e0 con 0x7f54fc15af40 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc0af800 con 0x7f54fc15af40 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f401b630 con 0x7f54fc15af40 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.590+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0afdc0 con 0x7f54fc15af40 2023-08-10T10:29:40.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.591+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc0b4660 con 0x7f54fc15af40 2023-08-10T10:29:40.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.592+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54f401b790 con 0x7f54fc15af40 2023-08-10T10:29:40.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.592+0000 7f54f27fc700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 0x7f54e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.592+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54f408a9e0 con 0x7f54fc15af40 2023-08-10T10:29:40.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.592+0000 7f550183f700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 0x7f54e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.593+0000 7f550183f700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 0x7f54e006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c960 tx=0x7f54ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.596+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54f4055b20 con 0x7f54fc15af40 2023-08-10T10:29:40.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.784+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54fc0b05c0 con 0x7f54fc15af40 2023-08-10T10:29:40.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.784+0000 7f54f27fc700 1 -- 172.21.15.161:0/3801376837 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54f4059140 con 0x7f54fc15af40 2023-08-10T10:29:40.786 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:40.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 msgr2=0x7f54e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 0x7f54e006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c960 tx=0x7f54ec008040 comp rx=0 tx=0).stop 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 msgr2=0x7f54fc15a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b730 tx=0x7f54f4004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 shutdown_connections 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f54e006ace0 0x7f54e006d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54fc15af40 0x7f54fc15a740 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54fc071a00 0x7f54fc14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 --2- 172.21.15.161:0/3801376837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54fc0c9fd0 0x7f54fc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 >> 172.21.15.161:0/3801376837 conn(0x7f54fc06a190 msgr2=0x7f54fc0c43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 shutdown_connections 2023-08-10T10:29:40.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.786+0000 7f5503aa3700 1 -- 172.21.15.161:0/3801376837 wait complete. 2023-08-10T10:29:40.799 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:40.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.922+0000 7f61abc07700 1 Processor -- start 2023-08-10T10:29:40.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.922+0000 7f61abc07700 1 -- start start 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61abc07700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b2120 0x7f61a40cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61abc07700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40b25b0 con 0x7f61a40cf730 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61abc07700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a406dc10 con 0x7f61a40cb9f0 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61abc07700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a4071950 con 0x7f61a40b2120 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61a91a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b2120 0x7f61a40cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61a91a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61a40b2120 0x7f61a40cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32810/0 (socket says 172.21.15.161:32810) 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61a91a2700 1 -- 172.21.15.161:0/2364293999 learned_addr learned my addr 172.21.15.161:0/2364293999 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.923+0000 7f61aa1a4700 1 --1- 172.21.15.161:0/2364293999 >> v1:172.21.15.161:6789/0 conn(0x7f61a40cf730 0x7f61a406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38050/0 (socket says 172.21.15.161:38050) 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a91a2700 1 -- 172.21.15.161:0/2364293999 >> v1:172.21.15.175:6789/0 conn(0x7f61a40cb9f0 legacy=0x7f61a4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a89a1700 1 -- 172.21.15.161:0/2364293999 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658114919 0 0) 0x7f61a40b25b0 con 0x7f61a40cf730 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a91a2700 1 -- 172.21.15.161:0/2364293999 >> v1:172.21.15.161:6789/0 conn(0x7f61a40cf730 legacy=0x7f61a406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a91a2700 1 -- 172.21.15.161:0/2364293999 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a406dff0 con 0x7f61a40b2120 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a91a2700 1 --2- 172.21.15.161:0/2364293999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b2120 0x7f61a40cf1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098f0 tx=0x7f61a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dee66aca576a28d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a89a1700 1 -- 172.21.15.161:0/2364293999 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000b8a0 con 0x7f61a40b2120 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a89a1700 1 -- 172.21.15.161:0/2364293999 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000ba00 con 0x7f61a40b2120 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61a89a1700 1 -- 172.21.15.161:0/2364293999 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000bd90 con 0x7f61a40b2120 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 -- 172.21.15.161:0/2364293999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b2120 msgr2=0x7f61a40cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 --2- 172.21.15.161:0/2364293999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b2120 0x7f61a40cf1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098f0 tx=0x7f61a0009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 -- 172.21.15.161:0/2364293999 shutdown_connections 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 --2- 172.21.15.161:0/2364293999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40b2120 0x7f61a40cf1f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 -- 172.21.15.161:0/2364293999 >> 172.21.15.161:0/2364293999 conn(0x7f61a40cc740 msgr2=0x7f61a40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:40.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.924+0000 7f61abc07700 1 -- 172.21.15.161:0/2364293999 shutdown_connections 2023-08-10T10:29:40.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.925+0000 7f61abc07700 1 -- 172.21.15.161:0/2364293999 wait complete. 2023-08-10T10:29:40.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 Processor -- start 2023-08-10T10:29:40.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 -- start start 2023-08-10T10:29:40.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 0x7f61a40c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 0x7f61a406a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40b4450 con 0x7f61a40cb9f0 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40b3840 con 0x7f61a40b2120 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61abc07700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40b3b20 con 0x7f61a40cf730 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61a91a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61a91a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32816/0 (socket says 172.21.15.161:32816) 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.926+0000 7f61a91a2700 1 -- 172.21.15.161:0/643609574 learned_addr learned my addr 172.21.15.161:0/643609574 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:40.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a99a3700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 0x7f61a40c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61aa1a4700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 0x7f61a406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 -- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 msgr2=0x7f61a406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 0x7f61a406a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 -- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 msgr2=0x7f61a40c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 0x7f61a40c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 -- 172.21.15.161:0/643609574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009550 con 0x7f61a40cb9f0 2023-08-10T10:29:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61aa1a4700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 0x7f61a406a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a99a3700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 0x7f61a40c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61a91a2700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f61a0014040 tx=0x7f61a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011a70 con 0x7f61a40cb9f0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a001e070 con 0x7f61a40cb9f0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011dd0 con 0x7f61a40cb9f0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a40b3e00 con 0x7f61a40cb9f0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.927+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a40c6590 con 0x7f61a40cb9f0 2023-08-10T10:29:40.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.928+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4067250 con 0x7f61a40cb9f0 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.928+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61a002d450 con 0x7f61a40cb9f0 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.929+0000 7f619a7fc700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 0x7f618806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.929+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61a008a560 con 0x7f61a40cb9f0 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.929+0000 7f61a99a3700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 0x7f618806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.929+0000 7f61a99a3700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 0x7f618806d1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6194000f60 tx=0x7f6194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:40.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:40.933+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f61a00556a0 con 0x7f61a40cb9f0 2023-08-10T10:29:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.118+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61a404ecc0 con 0x7f61a40cb9f0 2023-08-10T10:29:41.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.119+0000 7f619a7fc700 1 -- 172.21.15.161:0/643609574 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61a0058cc0 con 0x7f61a40cb9f0 2023-08-10T10:29:41.120 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:41.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 msgr2=0x7f618806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 0x7f618806d1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6194000f60 tx=0x7f6194009040 comp rx=0 tx=0).stop 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 msgr2=0x7f61a40c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f61a0014040 tx=0x7f61a0004750 comp rx=0 tx=0).stop 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 shutdown_connections 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f618806ad10 0x7f618806d1d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61a40cf730 0x7f61a406a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a40b2120 0x7f61a40c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 --2- 172.21.15.161:0/643609574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61a40cb9f0 0x7f61a40c6050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 >> 172.21.15.161:0/643609574 conn(0x7f61a40cc740 msgr2=0x7f61a406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:41.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 shutdown_connections 2023-08-10T10:29:41.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.121+0000 7f61abc07700 1 -- 172.21.15.161:0/643609574 wait complete. 2023-08-10T10:29:41.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:41.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.257+0000 7fd9b5b87700 1 Processor -- start 2023-08-10T10:29:41.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.257+0000 7fd9b5b87700 1 -- start start 2023-08-10T10:29:41.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9b5b87700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9b0159fd0 0x7fd9b015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9b5b87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9b5b87700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b015abb0 con 0x7fd9b015a3b0 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9b5b87700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b00b20f0 con 0x7fd9b0159fd0 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9b5b87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b015ae90 con 0x7fd9b00b1740 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9b0159fd0 0x7fd9b015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9aeffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd9b015a3b0 0x7fd9b00cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38062/0 (socket says 172.21.15.161:38062) 2023-08-10T10:29:41.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9aeffd700 1 -- 172.21.15.161:0/144736319 learned_addr learned my addr 172.21.15.161:0/144736319 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9b0159fd0 0x7fd9b015e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32822/0 (socket says 172.21.15.161:32822) 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9affff700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 -- 172.21.15.161:0/144736319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 msgr2=0x7fd9b00b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9ae7fc700 1 -- 172.21.15.161:0/144736319 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737435785 0 0) 0x7fd9b015abb0 con 0x7fd9b015a3b0 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 -- 172.21.15.161:0/144736319 >> v1:172.21.15.161:6789/0 conn(0x7fd9b015a3b0 legacy=0x7fd9b00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 -- 172.21.15.161:0/144736319 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b015b170 con 0x7fd9b0159fd0 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9affff700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9af7fe700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b015e4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009840 tx=0x7fd9a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b8a1ddb8362abd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9ae7fc700 1 -- 172.21.15.161:0/144736319 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0011830 con 0x7fd9b0159fd0 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9ae7fc700 1 -- 172.21.15.161:0/144736319 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a0011990 con 0x7fd9b0159fd0 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.258+0000 7fd9ae7fc700 1 -- 172.21.15.161:0/144736319 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0011d20 con 0x7fd9b0159fd0 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 -- 172.21.15.161:0/144736319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 msgr2=0x7fd9b015e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b015e4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009840 tx=0x7fd9a0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:41.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 -- 172.21.15.161:0/144736319 shutdown_connections 2023-08-10T10:29:41.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/144736319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b015e4f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 -- 172.21.15.161:0/144736319 >> 172.21.15.161:0/144736319 conn(0x7fd9b00cc740 msgr2=0x7fd9b00ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:41.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 -- 172.21.15.161:0/144736319 shutdown_connections 2023-08-10T10:29:41.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.259+0000 7fd9b5b87700 1 -- 172.21.15.161:0/144736319 wait complete. 2023-08-10T10:29:41.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.260+0000 7fd9b5b87700 1 Processor -- start 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.260+0000 7fd9b5b87700 1 -- start start 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9b015a3b0 0x7fd9b00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00b2f70 con 0x7fd9b0159fd0 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0150600 con 0x7fd9b015a3b0 2023-08-10T10:29:41.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9b5b87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b014fd60 con 0x7fd9b00b1740 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32830/0 (socket says 172.21.15.161:32830) 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9aeffd700 1 -- 172.21.15.161:0/2996308539 learned_addr learned my addr 172.21.15.161:0/2996308539 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9af7fe700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.261+0000 7fd9aeffd700 1 -- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 msgr2=0x7fd9b00c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9aeffd700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9aeffd700 1 -- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9b015a3b0 msgr2=0x7fd9b00b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9aeffd700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9b015a3b0 0x7fd9b00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9aeffd700 1 -- 172.21.15.161:0/2996308539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00094a0 con 0x7fd9b0159fd0 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9aeffd700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c550 tx=0x7fd9a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4004c80 con 0x7fd9b0159fd0 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4004e00 con 0x7fd9b0159fd0 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b0150040 con 0x7fd9b0159fd0 2023-08-10T10:29:41.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4007310 con 0x7fd9b0159fd0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.262+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b014ba70 con 0x7fd9b0159fd0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.263+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b00b3120 con 0x7fd9b0159fd0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.263+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9a4007470 con 0x7fd9b0159fd0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.264+0000 7fd997fff700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 0x7fd99c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.264+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9a40891c0 con 0x7fd9b0159fd0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.264+0000 7fd9af7fe700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 0x7fd99c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.264+0000 7fd9af7fe700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 0x7fd99c06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000c00 tx=0x7fd9a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.268+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd9b00b3120 con 0x7fd9b0159fd0 2023-08-10T10:29:41.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.459+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9b004ecc0 con 0x7fd9b0159fd0 2023-08-10T10:29:41.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.459+0000 7fd997fff700 1 -- 172.21.15.161:0/2996308539 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9a4054270 con 0x7fd9b0159fd0 2023-08-10T10:29:41.461 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:41.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 msgr2=0x7fd99c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 0x7fd99c06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000c00 tx=0x7fd9a0008030 comp rx=0 tx=0).stop 2023-08-10T10:29:41.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 msgr2=0x7fd9b014b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c550 tx=0x7fd9a400c910 comp rx=0 tx=0).stop 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 shutdown_connections 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fd99c06ace0 0x7fd99c06d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9b015a3b0 0x7fd9b00b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9b00b1740 0x7fd9b00c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 --2- 172.21.15.161:0/2996308539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b0159fd0 0x7fd9b014b530 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.461+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 >> 172.21.15.161:0/2996308539 conn(0x7fd9b00cc740 msgr2=0x7fd9b00cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.462+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 shutdown_connections 2023-08-10T10:29:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.462+0000 7fd9b5b87700 1 -- 172.21.15.161:0/2996308539 wait complete. 2023-08-10T10:29:41.475 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:29:41.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.596+0000 7fca01a04700 1 Processor -- start 2023-08-10T10:29:41.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.596+0000 7fca01a04700 1 -- start start 2023-08-10T10:29:41.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.597+0000 7fca01a04700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.597+0000 7fca01a04700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.597+0000 7fca01a04700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc15e520 con 0x7fc9fc070fe0 2023-08-10T10:29:41.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.597+0000 7fca01a04700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cda40 con 0x7fc9fc15aac0 2023-08-10T10:29:41.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.597+0000 7fca01a04700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc071410 con 0x7fc9fc0c6460 2023-08-10T10:29:41.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9faffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9faffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59870/0 (socket says 172.21.15.161:59870) 2023-08-10T10:29:41.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9faffd700 1 -- 172.21.15.161:0/1052583487 learned_addr learned my addr 172.21.15.161:0/1052583487 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:41.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 --2- 172.21.15.161:0/1052583487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9f9ffb700 1 -- 172.21.15.161:0/1052583487 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398597855 0 0) 0x7fc9fc15e520 con 0x7fc9fc070fe0 2023-08-10T10:29:41.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9f9ffb700 1 -- 172.21.15.161:0/1052583487 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e40035b0 con 0x7fc9fc070fe0 2023-08-10T10:29:41.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 -- 172.21.15.161:0/1052583487 >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 msgr2=0x7fc9fc0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:41.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 --2- 172.21.15.161:0/1052583487 >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 -- 172.21.15.161:0/1052583487 >> v1:172.21.15.175:6789/0 conn(0x7fc9fc070fe0 legacy=0x7fc9fc06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 -- 172.21.15.161:0/1052583487 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0cf8d0 con 0x7fc9fc0c6460 2023-08-10T10:29:41.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9faffd700 1 --2- 172.21.15.161:0/1052583487 >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:41.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9fa7fc700 1 --2- 172.21.15.161:0/1052583487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc070aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009840 tx=0x7fc9ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19d3079c7423b3d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.598+0000 7fc9f9ffb700 1 -- 172.21.15.161:0/1052583487 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011830 con 0x7fc9fc0c6460 2023-08-10T10:29:41.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fc9f9ffb700 1 -- 172.21.15.161:0/1052583487 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec011990 con 0x7fc9fc0c6460 2023-08-10T10:29:41.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fc9f9ffb700 1 -- 172.21.15.161:0/1052583487 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011d00 con 0x7fc9fc0c6460 2023-08-10T10:29:41.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 -- 172.21.15.161:0/1052583487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 msgr2=0x7fc9fc070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 --2- 172.21.15.161:0/1052583487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc070aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009840 tx=0x7fc9ec009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:41.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 -- 172.21.15.161:0/1052583487 shutdown_connections 2023-08-10T10:29:41.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 --2- 172.21.15.161:0/1052583487 >> v2:172.21.15.175:3300/0 conn(0x7fc9fc15aac0 0x7fc9fc0cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 --2- 172.21.15.161:0/1052583487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc070aa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 -- 172.21.15.161:0/1052583487 >> 172.21.15.161:0/1052583487 conn(0x7fc9fc0cfb40 msgr2=0x7fc9fc0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:41.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 -- 172.21.15.161:0/1052583487 shutdown_connections 2023-08-10T10:29:41.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.599+0000 7fca01a04700 1 -- 172.21.15.161:0/1052583487 wait complete. 2023-08-10T10:29:41.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.600+0000 7fca01a04700 1 Processor -- start 2023-08-10T10:29:41.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.600+0000 7fca01a04700 1 -- start start 2023-08-10T10:29:41.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9fc070fe0 0x7fc9fc1e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1f2b90 con 0x7fc9fc15aac0 2023-08-10T10:29:41.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0b5030 con 0x7fc9fc070fe0 2023-08-10T10:29:41.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fca01a04700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1e8040 con 0x7fc9fc0c6460 2023-08-10T10:29:41.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fc9fb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fc9fb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32846/0 (socket says 172.21.15.161:32846) 2023-08-10T10:29:41.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fc9fb7fe700 1 -- 172.21.15.161:0/592175809 learned_addr learned my addr 172.21.15.161:0/592175809 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:41.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fc9faffd700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9fc070fe0 0x7fc9fc1e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.601+0000 7fc9fa7fc700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 -- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 msgr2=0x7fc9fc0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc0b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 -- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9fc070fe0 msgr2=0x7fc9fc1e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9fc070fe0 0x7fc9fc1e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 -- 172.21.15.161:0/592175809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0009550 con 0x7fc9fc15aac0 2023-08-10T10:29:41.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9fb7fe700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400cc20 tx=0x7fc9f400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4003c00 con 0x7fc9fc15aac0 2023-08-10T10:29:41.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4003d60 con 0x7fc9fc15aac0 2023-08-10T10:29:41.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0094a0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400aae0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.602+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc1e8600 con 0x7fc9fc15aac0 2023-08-10T10:29:41.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.603+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc1597d0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.603+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9f400ac40 con 0x7fc9fc15aac0 2023-08-10T10:29:41.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.604+0000 7fc9e3fff700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 0x7fc9e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:41.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.604+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9f4089470 con 0x7fc9fc15aac0 2023-08-10T10:29:41.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.604+0000 7fc9faffd700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 0x7fc9e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:41.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.604+0000 7fc9faffd700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 0x7fc9e806d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0006d30 tx=0x7fc9f00092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:41.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.608+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9f40545b0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.811+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc9fc04ecc0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.812+0000 7fc9e3fff700 1 -- 172.21.15.161:0/592175809 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc9f4057bd0 con 0x7fc9fc15aac0 2023-08-10T10:29:41.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 msgr2=0x7fc9e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 0x7fc9e806d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0006d30 tx=0x7fc9f00092c0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 msgr2=0x7fc9fc0b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:41.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400cc20 tx=0x7fc9f400cf30 comp rx=0 tx=0).stop 2023-08-10T10:29:41.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 shutdown_connections 2023-08-10T10:29:41.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc9e806ace0 0x7fc9e806d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9fc15aac0 0x7fc9fc0b0a90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9fc070fe0 0x7fc9fc1e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 --2- 172.21.15.161:0/592175809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9fc0c6460 0x7fc9fc0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:41.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 >> 172.21.15.161:0/592175809 conn(0x7fc9fc0cfb40 msgr2=0x7fc9fc0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:41.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 shutdown_connections 2023-08-10T10:29:41.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:41.814+0000 7fca01a04700 1 -- 172.21.15.161:0/592175809 wait complete. 2023-08-10T10:29:41.818 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-08-10T10:29:41.827 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:29:41.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:41.828 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-10T10:29:41.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:29:41.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:41.864 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:29:41.925 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:41.925 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:41.946 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:41.947 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:42.006 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:42.006 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:42.065 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:42.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.185+0000 7febe53bc700 1 Processor -- start 2023-08-10T10:29:42.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.185+0000 7febe53bc700 1 -- start start 2023-08-10T10:29:42.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febe53bc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febe015d540 0x7febe00d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febe53bc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7febe00d0450 0x7febe00b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febe53bc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe00d1680 con 0x7febe00cf960 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febe53bc700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe00d1960 con 0x7febe00d0450 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febe53bc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe00d1c40 con 0x7febe015d540 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7febe00d0450 0x7febe00b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7febe00d0450 0x7febe00b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32852/0 (socket says 172.21.15.161:32852) 2023-08-10T10:29:42.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 -- 172.21.15.161:0/3887661140 learned_addr learned my addr 172.21.15.161:0/3887661140 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febde7fc700 1 --2- 172.21.15.161:0/3887661140 >> v2:172.21.15.175:3300/0 conn(0x7febe015d540 0x7febe00d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 -- 172.21.15.161:0/3887661140 >> v2:172.21.15.175:3300/0 conn(0x7febe015d540 msgr2=0x7febe00d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 --2- 172.21.15.161:0/3887661140 >> v2:172.21.15.175:3300/0 conn(0x7febe015d540 0x7febe00d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 -- 172.21.15.161:0/3887661140 >> v1:172.21.15.175:6789/0 conn(0x7febe00cf960 legacy=0x7febe00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.186+0000 7febdf7fe700 1 -- 172.21.15.161:0/3887661140 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe00d1f20 con 0x7febe00d0450 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febdf7fe700 1 --2- 172.21.15.161:0/3887661140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00d0450 0x7febe00b2f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7febe00b4ac0 tx=0x7febd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d096666141e1a82 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febddffb700 1 -- 172.21.15.161:0/3887661140 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd800e070 con 0x7febe00d0450 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febddffb700 1 -- 172.21.15.161:0/3887661140 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8003a20 con 0x7febe00d0450 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febddffb700 1 -- 172.21.15.161:0/3887661140 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8003dd0 con 0x7febe00d0450 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 -- 172.21.15.161:0/3887661140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00d0450 msgr2=0x7febe00b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 --2- 172.21.15.161:0/3887661140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00d0450 0x7febe00b2f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7febe00b4ac0 tx=0x7febd800b330 comp rx=0 tx=0).stop 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 -- 172.21.15.161:0/3887661140 shutdown_connections 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 --2- 172.21.15.161:0/3887661140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00d0450 0x7febe00b2f80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 --2- 172.21.15.161:0/3887661140 >> v2:172.21.15.175:3300/0 conn(0x7febe015d540 0x7febe00d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 -- 172.21.15.161:0/3887661140 >> 172.21.15.161:0/3887661140 conn(0x7febe00d3000 msgr2=0x7febe00d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:42.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 -- 172.21.15.161:0/3887661140 shutdown_connections 2023-08-10T10:29:42.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.187+0000 7febe53bc700 1 -- 172.21.15.161:0/3887661140 wait complete. 2023-08-10T10:29:42.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 Processor -- start 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 -- start start 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe00d0450 0x7febe0158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe015d540 0x7febe0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe0157cb0 con 0x7febe00cf960 2023-08-10T10:29:42.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe00ca0d0 con 0x7febe015d540 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.189+0000 7febe53bc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe0156750 con 0x7febe00d0450 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32856/0 (socket says 172.21.15.161:32856) 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 -- 172.21.15.161:0/2689484667 learned_addr learned my addr 172.21.15.161:0/2689484667 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 -- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe00d0450 msgr2=0x7febe0158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe00d0450 0x7febe0158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 -- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe015d540 msgr2=0x7febe0158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe015d540 0x7febe0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 -- 172.21.15.161:0/2689484667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8009b30 con 0x7febe00cf960 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febdeffd700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febd400c4b0 tx=0x7febd400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011790 con 0x7febe00cf960 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd40118f0 con 0x7febe00cf960 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe00d0a20 con 0x7febe00cf960 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011ca0 con 0x7febe00cf960 2023-08-10T10:29:42.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.190+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe00ca390 con 0x7febe00cf960 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.191+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe00744e0 con 0x7febe00cf960 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.192+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febd4012420 con 0x7febe00cf960 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.192+0000 7febc77fe700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 0x7febcc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.192+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febd4089030 con 0x7febe00cf960 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.192+0000 7febde7fc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 0x7febcc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.192+0000 7febde7fc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 0x7febcc06d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febe00ce7f0 tx=0x7febd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.196+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febd40540e0 con 0x7febe00cf960 2023-08-10T10:29:42.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.387+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febe00b2350 con 0x7febe00cf960 2023-08-10T10:29:42.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.388+0000 7febc77fe700 1 -- 172.21.15.161:0/2689484667 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7febd4057700 con 0x7febe00cf960 2023-08-10T10:29:42.389 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:42.390 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:04.428920+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:42.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 msgr2=0x7febcc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 0x7febcc06d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febe00ce7f0 tx=0x7febd0008040 comp rx=0 tx=0).stop 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 msgr2=0x7febe0156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febd400c4b0 tx=0x7febd400c870 comp rx=0 tx=0).stop 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 shutdown_connections 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7febcc06ace0 0x7febcc06d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe015d540 0x7febe0158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe00cf960 0x7febe0156210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 --2- 172.21.15.161:0/2689484667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe00d0450 0x7febe0158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 >> 172.21.15.161:0/2689484667 conn(0x7febe00d3000 msgr2=0x7febe00cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:42.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.390+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 shutdown_connections 2023-08-10T10:29:42.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.391+0000 7febe53bc700 1 -- 172.21.15.161:0/2689484667 wait complete. 2023-08-10T10:29:42.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:42.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:42.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.530+0000 7f450beac700 1 Processor -- start 2023-08-10T10:29:42.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 -- start start 2023-08-10T10:29:42.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 0x7f45040b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f450406a190 0x7f450406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450406aae0 con 0x7f4504160d20 2023-08-10T10:29:42.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4504071950 con 0x7f450406a190 2023-08-10T10:29:42.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.531+0000 7f450beac700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040b2660 con 0x7f45040cb9f0 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4509447700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4504160d20 0x7f45040cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38102/0 (socket says 172.21.15.161:38102) 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4509447700 1 -- 172.21.15.161:0/3932018058 learned_addr learned my addr 172.21.15.161:0/3932018058 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 --2- 172.21.15.161:0/3932018058 >> v2:172.21.15.161:3300/0 conn(0x7f450406a190 0x7f450406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4509c48700 1 --2- 172.21.15.161:0/3932018058 >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 0x7f45040b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 -- 172.21.15.161:0/3932018058 >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 msgr2=0x7f45040b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 --2- 172.21.15.161:0/3932018058 >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 0x7f45040b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 -- 172.21.15.161:0/3932018058 >> v1:172.21.15.161:6789/0 conn(0x7f4504160d20 legacy=0x7f45040cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 -- 172.21.15.161:0/3932018058 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450406dc10 con 0x7f450406a190 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4508c46700 1 -- 172.21.15.161:0/3932018058 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222242272 0 0) 0x7f450406aae0 con 0x7f4504160d20 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4509c48700 1 --2- 172.21.15.161:0/3932018058 >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 0x7f45040b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f450a449700 1 --2- 172.21.15.161:0/3932018058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f450406a5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f45040b2820 tx=0x7f44fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeabd129e9b6bb18 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4508c46700 1 -- 172.21.15.161:0/3932018058 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc00e070 con 0x7f450406a190 2023-08-10T10:29:42.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4508c46700 1 -- 172.21.15.161:0/3932018058 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc00bbd0 con 0x7f450406a190 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.532+0000 7f4508c46700 1 -- 172.21.15.161:0/3932018058 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc012430 con 0x7f450406a190 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 -- 172.21.15.161:0/3932018058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 msgr2=0x7f450406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 --2- 172.21.15.161:0/3932018058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f450406a5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f45040b2820 tx=0x7f44fc00b330 comp rx=0 tx=0).stop 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 -- 172.21.15.161:0/3932018058 shutdown_connections 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 --2- 172.21.15.161:0/3932018058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f450406a5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 --2- 172.21.15.161:0/3932018058 >> v2:172.21.15.175:3300/0 conn(0x7f45040cb9f0 0x7f45040b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 -- 172.21.15.161:0/3932018058 >> 172.21.15.161:0/3932018058 conn(0x7f45040cc740 msgr2=0x7f45040ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:42.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 -- 172.21.15.161:0/3932018058 shutdown_connections 2023-08-10T10:29:42.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.533+0000 7f450beac700 1 -- 172.21.15.161:0/3932018058 wait complete. 2023-08-10T10:29:42.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.534+0000 7f450beac700 1 Processor -- start 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.534+0000 7f450beac700 1 -- start start 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45040cb9f0 0x7f45040aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4504160d20 0x7f45040af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b33d0 con 0x7f450406a190 2023-08-10T10:29:42.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b2850 con 0x7f45040cb9f0 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450beac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b2aa0 con 0x7f4504160d20 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32870/0 (socket says 172.21.15.161:32870) 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 -- 172.21.15.161:0/237688045 learned_addr learned my addr 172.21.15.161:0/237688045 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509447700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45040cb9f0 0x7f45040aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f450a449700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4504160d20 0x7f45040af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 -- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4504160d20 msgr2=0x7f45040af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4504160d20 0x7f45040af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 -- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45040cb9f0 msgr2=0x7f45040aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45040cb9f0 0x7f45040aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 -- 172.21.15.161:0/237688045 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc009a70 con 0x7f450406a190 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f4509c48700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e810 tx=0x7f44f400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400c070 con 0x7f450406a190 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4004230 con 0x7f450406a190 2023-08-10T10:29:42.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.535+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40036a0 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.536+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040b2d80 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.536+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45040b0c90 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.537+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040b14d0 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.537+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44f4003800 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.537+0000 7f44fa7fc700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 0x7f44e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.537+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44f4089070 con 0x7f450406a190 2023-08-10T10:29:42.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.537+0000 7f4509447700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 0x7f44e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.538+0000 7f4509447700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 0x7f44e806d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45040c36f0 tx=0x7f4500007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.542+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f44f40541b0 con 0x7f450406a190 2023-08-10T10:29:42.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.729+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4504160b10 con 0x7f450406a190 2023-08-10T10:29:42.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.729+0000 7f44fa7fc700 1 -- 172.21.15.161:0/237688045 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4504160b10 con 0x7f450406a190 2023-08-10T10:29:42.730 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:42.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 msgr2=0x7f44e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 0x7f44e806d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45040c36f0 tx=0x7f4500007de0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 msgr2=0x7f45040b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e810 tx=0x7f44f400eb20 comp rx=0 tx=0).stop 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 shutdown_connections 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f44e806ace0 0x7f44e806d1a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4504160d20 0x7f45040af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f450406a190 0x7f45040b0750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 --2- 172.21.15.161:0/237688045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45040cb9f0 0x7f45040aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 >> 172.21.15.161:0/237688045 conn(0x7f45040cc740 msgr2=0x7f45040cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:42.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 shutdown_connections 2023-08-10T10:29:42.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.731+0000 7f450beac700 1 -- 172.21.15.161:0/237688045 wait complete. 2023-08-10T10:29:42.744 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:42.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.867+0000 7f8292d9e700 1 Processor -- start 2023-08-10T10:29:42.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.867+0000 7f8292d9e700 1 -- start start 2023-08-10T10:29:42.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8292d9e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 0x7f828c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8292d9e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f828c06a190 0x7f828c06a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8292d9e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c06c460 con 0x7f828c15d410 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8292d9e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c15d7f0 con 0x7f828c06a190 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8292d9e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c06d8b0 con 0x7f828c06d450 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829259d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f828c06a190 0x7f828c06a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8291d9c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f828c15d410 0x7f828c065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38116/0 (socket says 172.21.15.161:38116) 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8291d9c700 1 -- 172.21.15.161:0/3414795880 learned_addr learned my addr 172.21.15.161:0/3414795880 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:42.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829159b700 1 --2- 172.21.15.161:0/3414795880 >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 0x7f828c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829259d700 1 -- 172.21.15.161:0/3414795880 >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 msgr2=0x7f828c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829259d700 1 --2- 172.21.15.161:0/3414795880 >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 0x7f828c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829259d700 1 -- 172.21.15.161:0/3414795880 >> v1:172.21.15.161:6789/0 conn(0x7f828c15d410 legacy=0x7f828c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829259d700 1 -- 172.21.15.161:0/3414795880 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c06ab20 con 0x7f828c06a190 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f8290d9a700 1 -- 172.21.15.161:0/3414795880 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757548732 0 0) 0x7f828c06c460 con 0x7f828c15d410 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.868+0000 7f829159b700 1 --2- 172.21.15.161:0/3414795880 >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 0x7f828c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f829259d700 1 --2- 172.21.15.161:0/3414795880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06a190 0x7f828c06a5e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f828c0cce80 tx=0x7f828400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223c5e3cc9eaa6b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8290d9a700 1 -- 172.21.15.161:0/3414795880 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400e070 con 0x7f828c06a190 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8290d9a700 1 -- 172.21.15.161:0/3414795880 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400bb90 con 0x7f828c06a190 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8290d9a700 1 -- 172.21.15.161:0/3414795880 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284012430 con 0x7f828c06a190 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 -- 172.21.15.161:0/3414795880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06a190 msgr2=0x7f828c06a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3414795880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06a190 0x7f828c06a5e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f828c0cce80 tx=0x7f828400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 -- 172.21.15.161:0/3414795880 shutdown_connections 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3414795880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06a190 0x7f828c06a5e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3414795880 >> v2:172.21.15.175:3300/0 conn(0x7f828c06d450 0x7f828c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 -- 172.21.15.161:0/3414795880 >> 172.21.15.161:0/3414795880 conn(0x7f828c0b22d0 msgr2=0x7f828c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:42.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 -- 172.21.15.161:0/3414795880 shutdown_connections 2023-08-10T10:29:42.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.869+0000 7f8292d9e700 1 -- 172.21.15.161:0/3414795880 wait complete. 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 Processor -- start 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 -- start start 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f828c06a190 0x7f828c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f828c15d410 0x7f828c15fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15d930 con 0x7f828c06d450 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15dc10 con 0x7f828c06a190 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.871+0000 7f8292d9e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1522d0 con 0x7f828c15d410 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32886/0 (socket says 172.21.15.161:32886) 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 -- 172.21.15.161:0/3348351158 learned_addr learned my addr 172.21.15.161:0/3348351158 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829259d700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f828c15d410 0x7f828c15fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 -- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f828c15d410 msgr2=0x7f828c15fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f828c15d410 0x7f828c15fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f8291d9c700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f828c06a190 0x7f828c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 -- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f828c06a190 msgr2=0x7f828c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f828c06a190 0x7f828c158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 -- 172.21.15.161:0/3348351158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009a70 con 0x7f828c06d450 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f829159b700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f828800c7b0 tx=0x7f828800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011800 con 0x7f828c06d450 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288011960 con 0x7f828c06d450 2023-08-10T10:29:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c156fb0 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011cd0 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.872+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c157570 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.873+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c157790 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.873+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8288021350 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.874+0000 7f82827fc700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 0x7f827006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.874+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8288089420 con 0x7f828c06d450 2023-08-10T10:29:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.874+0000 7f8291d9c700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 0x7f827006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:42.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.874+0000 7f8291d9c700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 0x7f827006d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f827c000f60 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:42.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:42.878+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8288057f70 con 0x7f828c06d450 2023-08-10T10:29:43.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.066+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f828c061da0 con 0x7f828c06d450 2023-08-10T10:29:43.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.066+0000 7f82827fc700 1 -- 172.21.15.161:0/3348351158 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8288057b00 con 0x7f828c06d450 2023-08-10T10:29:43.068 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:43.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 msgr2=0x7f827006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 0x7f827006d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f827c000f60 tx=0x7f827c009040 comp rx=0 tx=0).stop 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 msgr2=0x7f828c15f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f828800c7b0 tx=0x7f828800cb70 comp rx=0 tx=0).stop 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 shutdown_connections 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f827006ace0 0x7f827006d1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f828c15d410 0x7f828c15fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f828c06a190 0x7f828c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 --2- 172.21.15.161:0/3348351158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f828c06d450 0x7f828c15f7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 >> 172.21.15.161:0/3348351158 conn(0x7f828c0b22d0 msgr2=0x7f828c15bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 shutdown_connections 2023-08-10T10:29:43.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.068+0000 7f8292d9e700 1 -- 172.21.15.161:0/3348351158 wait complete. 2023-08-10T10:29:43.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:43.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.204+0000 7f10f9b5a700 1 Processor -- start 2023-08-10T10:29:43.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.204+0000 7f10f9b5a700 1 -- start start 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f9b5a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 0x7f10f40ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f9b5a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 0x7f10f406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f9b5a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40ca370 con 0x7f10f4159c20 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f9b5a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40ca090 con 0x7f10f4159840 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f9b5a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4071900 con 0x7f10f4072070 2023-08-10T10:29:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f37fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 0x7f10f40ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 0x7f10f406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f37fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 0x7f10f40ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59926/0 (socket says 172.21.15.161:59926) 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f37fe700 1 -- 172.21.15.161:0/590374390 learned_addr learned my addr 172.21.15.161:0/590374390 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f2ffd700 1 --1- 172.21.15.161:0/590374390 >> v1:172.21.15.175:6789/0 conn(0x7f10f4159c20 0x7f10f406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39922/0 (socket says 172.21.15.161:39922) 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f3fff700 1 -- 172.21.15.161:0/590374390 >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 msgr2=0x7f10f40ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f3fff700 1 --2- 172.21.15.161:0/590374390 >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 0x7f10f40ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f3fff700 1 -- 172.21.15.161:0/590374390 >> v1:172.21.15.175:6789/0 conn(0x7f10f4159c20 legacy=0x7f10f406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f27fc700 1 -- 172.21.15.161:0/590374390 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085866309 0 0) 0x7f10f40ca370 con 0x7f10f4159c20 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.205+0000 7f10f3fff700 1 -- 172.21.15.161:0/590374390 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4071be0 con 0x7f10f4072070 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f3fff700 1 --2- 172.21.15.161:0/590374390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 0x7f10f406b2b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00bfa0 tx=0x7f10ec00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7867269f9699a03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f27fc700 1 -- 172.21.15.161:0/590374390 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec010070 con 0x7f10f4072070 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f27fc700 1 -- 172.21.15.161:0/590374390 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00b2e0 con 0x7f10f4072070 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f27fc700 1 -- 172.21.15.161:0/590374390 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00dc40 con 0x7f10f4072070 2023-08-10T10:29:43.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 -- 172.21.15.161:0/590374390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 msgr2=0x7f10f406b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/590374390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 0x7f10f406b2b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00bfa0 tx=0x7f10ec00d330 comp rx=0 tx=0).stop 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 -- 172.21.15.161:0/590374390 shutdown_connections 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/590374390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4072070 0x7f10f406b2b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/590374390 >> v2:172.21.15.175:3300/0 conn(0x7f10f4159840 0x7f10f40ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 -- 172.21.15.161:0/590374390 >> 172.21.15.161:0/590374390 conn(0x7f10f40cf4c0 msgr2=0x7f10f40cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 -- 172.21.15.161:0/590374390 shutdown_connections 2023-08-10T10:29:43.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.206+0000 7f10f9b5a700 1 -- 172.21.15.161:0/590374390 wait complete. 2023-08-10T10:29:43.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.207+0000 7f10f9b5a700 1 Processor -- start 2023-08-10T10:29:43.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 -- start start 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f4072070 0x7f10f40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4159840 0x7f10f40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40b3100 con 0x7f10f4159c20 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c82f0 con 0x7f10f4072070 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.208+0000 7f10f9b5a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c85d0 con 0x7f10f4159840 2023-08-10T10:29:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32902/0 (socket says 172.21.15.161:32902) 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 -- 172.21.15.161:0/2896476588 learned_addr learned my addr 172.21.15.161:0/2896476588 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f37fe700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f4072070 0x7f10f40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f2ffd700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4159840 0x7f10f40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 -- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4159840 msgr2=0x7f10f40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4159840 0x7f10f40c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 -- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f4072070 msgr2=0x7f10f40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f4072070 0x7f10f40c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 -- 172.21.15.161:0/2896476588 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec00bc80 con 0x7f10f4159c20 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f3fff700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10f4071a40 tx=0x7f10ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec003e90 con 0x7f10f4159c20 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec004250 con 0x7f10f4159c20 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec004600 con 0x7f10f4159c20 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f40c88b0 con 0x7f10f4159c20 2023-08-10T10:29:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.209+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f40c7fa0 con 0x7f10f4159c20 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.210+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f4073b10 con 0x7f10f4159c20 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.211+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10ec004760 con 0x7f10f4159c20 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.211+0000 7f10dbfff700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 0x7f10e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.211+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10ec08cad0 con 0x7f10f4159c20 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.211+0000 7f10f37fe700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 0x7f10e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.211+0000 7f10f37fe700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 0x7f10e006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009b60 tx=0x7f10e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.215+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10ec057c10 con 0x7f10f4159c20 2023-08-10T10:29:43.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.401+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10f404ecc0 con 0x7f10f4159c20 2023-08-10T10:29:43.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.401+0000 7f10dbfff700 1 -- 172.21.15.161:0/2896476588 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10ec022020 con 0x7f10f4159c20 2023-08-10T10:29:43.403 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:43.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 msgr2=0x7f10e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 0x7f10e006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009b60 tx=0x7f10e4008040 comp rx=0 tx=0).stop 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 msgr2=0x7f10f40b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10f4071a40 tx=0x7f10ec004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 shutdown_connections 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f10e006ace0 0x7f10e006d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4159c20 0x7f10f40b44d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f4072070 0x7f10f40c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 --2- 172.21.15.161:0/2896476588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10f4159840 0x7f10f40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.403+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 >> 172.21.15.161:0/2896476588 conn(0x7f10f40cf4c0 msgr2=0x7f10f406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.404+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 shutdown_connections 2023-08-10T10:29:43.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.404+0000 7f10f9b5a700 1 -- 172.21.15.161:0/2896476588 wait complete. 2023-08-10T10:29:43.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:43.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.542+0000 7f7cbd557700 1 Processor -- start 2023-08-10T10:29:43.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.542+0000 7f7cbd557700 1 -- start start 2023-08-10T10:29:43.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7cb815e5e0 0x7f7cb80cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cb920 0x7f7cb80cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 0x7f7cb80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80ce0d0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb815e9c0 con 0x7f7cb80cdc40 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cbd557700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80cc1c0 con 0x7f7cb80cb920 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cb6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7cb815e5e0 0x7f7cb80cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cb6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7cb815e5e0 0x7f7cb80cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32906/0 (socket says 172.21.15.161:32906) 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.543+0000 7f7cb6ffd700 1 -- 172.21.15.161:0/3911664688 learned_addr learned my addr 172.21.15.161:0/3911664688 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb77fe700 1 --2- 172.21.15.161:0/3911664688 >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 0x7f7cb80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 -- 172.21.15.161:0/3911664688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cb920 msgr2=0x7f7cb80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb67fc700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cb920 0x7f7cb80cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cb920 0x7f7cb80cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 -- 172.21.15.161:0/3911664688 >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 msgr2=0x7f7cb80ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3911664688 >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 0x7f7cb80ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 -- 172.21.15.161:0/3911664688 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80cc4a0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb77fe700 1 --2- 172.21.15.161:0/3911664688 >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 0x7f7cb80ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb80cfa30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806dd30 tx=0x7f7cac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5945abfe78ffc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb5ffb700 1 -- 172.21.15.161:0/3911664688 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00b870 con 0x7f7cb815e5e0 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb5ffb700 1 -- 172.21.15.161:0/3911664688 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b9d0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cb5ffb700 1 -- 172.21.15.161:0/3911664688 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00bd60 con 0x7f7cb815e5e0 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 -- 172.21.15.161:0/3911664688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 msgr2=0x7f7cb80cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb80cfa30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806dd30 tx=0x7f7cac009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 -- 172.21.15.161:0/3911664688 shutdown_connections 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3911664688 >> v2:172.21.15.175:3300/0 conn(0x7f7cb80cdc40 0x7f7cb80ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb80cfa30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3911664688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cb920 0x7f7cb80cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.544+0000 7f7cbd557700 1 -- 172.21.15.161:0/3911664688 >> 172.21.15.161:0/3911664688 conn(0x7f7cb809a140 msgr2=0x7f7cb80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.545+0000 7f7cbd557700 1 -- 172.21.15.161:0/3911664688 shutdown_connections 2023-08-10T10:29:43.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.545+0000 7f7cbd557700 1 -- 172.21.15.161:0/3911664688 wait complete. 2023-08-10T10:29:43.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.546+0000 7f7cbd557700 1 Processor -- start 2023-08-10T10:29:43.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.546+0000 7f7cbd557700 1 -- start start 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb80cb920 0x7f7cb80c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 0x7f7cb81e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ca670 con 0x7f7cb815e5e0 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806b2a0 con 0x7f7cb80cb920 2023-08-10T10:29:43.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806cee0 con 0x7f7cb80cdc40 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32914/0 (socket says 172.21.15.161:32914) 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 -- 172.21.15.161:0/3973556745 learned_addr learned my addr 172.21.15.161:0/3973556745 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb80cb920 0x7f7cb80c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb67fc700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 0x7f7cb81e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 -- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 msgr2=0x7f7cb81e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 0x7f7cb81e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 -- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb80cb920 msgr2=0x7f7cb80c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb80cb920 0x7f7cb80c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 -- 172.21.15.161:0/3973556745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac009550 con 0x7f7cb815e5e0 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb67fc700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 0x7f7cb81e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cb77fe700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000cef0 tx=0x7f7cb000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000ae50 con 0x7f7cb815e5e0 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0015440 con 0x7f7cb815e5e0 2023-08-10T10:29:43.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb806d1c0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00157f0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.547+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb81e5140 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.548+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb804ecc0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.549+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cb000d430 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.549+0000 7f7c9f7fe700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 0x7f7ca406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.549+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cb0089a50 con 0x7f7cb815e5e0 2023-08-10T10:29:43.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.549+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 0x7f7ca406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.550+0000 7f7cb6ffd700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 0x7f7ca406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cac000c00 tx=0x7f7cac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.553+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7cb0054b00 con 0x7f7cb815e5e0 2023-08-10T10:29:43.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.740+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cb80b0dc0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.740+0000 7f7c9f7fe700 1 -- 172.21.15.161:0/3973556745 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cb001a0a0 con 0x7f7cb815e5e0 2023-08-10T10:29:43.742 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 msgr2=0x7f7ca406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 0x7f7ca406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cac000c00 tx=0x7f7cac008030 comp rx=0 tx=0).stop 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 msgr2=0x7f7cb81e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000cef0 tx=0x7f7cb000a340 comp rx=0 tx=0).stop 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 shutdown_connections 2023-08-10T10:29:43.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ca406ace0 0x7f7ca406d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb815e5e0 0x7f7cb81e4c00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb80cb920 0x7f7cb80c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 --2- 172.21.15.161:0/3973556745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cb80cdc40 0x7f7cb81e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 >> 172.21.15.161:0/3973556745 conn(0x7f7cb809a140 msgr2=0x7f7cb80cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 shutdown_connections 2023-08-10T10:29:43.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.742+0000 7f7cbd557700 1 -- 172.21.15.161:0/3973556745 wait complete. 2023-08-10T10:29:43.755 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:29:43.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.875+0000 7f005cdc6700 1 Processor -- start 2023-08-10T10:29:43.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.875+0000 7f005cdc6700 1 -- start start 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005cdc6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005cdc6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00580660d0 0x7f00580ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005cdc6700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0058071e80 con 0x7f005815b330 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005cdc6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580cf240 con 0x7f00580660d0 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005cdc6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0058070400 con 0x7f00580cd350 2023-08-10T10:29:43.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0056d9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00580660d0 0x7f00580ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0055d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f005815b330 0x7f00580cd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38156/0 (socket says 172.21.15.161:38156) 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0055d9b700 1 -- 172.21.15.161:0/2747768415 learned_addr learned my addr 172.21.15.161:0/2747768415 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005659c700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0056d9d700 1 -- 172.21.15.161:0/2747768415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 msgr2=0x7f00580b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0056d9d700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0056d9d700 1 -- 172.21.15.161:0/2747768415 >> v1:172.21.15.161:6789/0 conn(0x7f005815b330 legacy=0x7f00580cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f005559a700 1 -- 172.21.15.161:0/2747768415 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643720869 0 0) 0x7f0058071e80 con 0x7f005815b330 2023-08-10T10:29:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.876+0000 7f0056d9d700 1 -- 172.21.15.161:0/2747768415 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580706a0 con 0x7f00580660d0 2023-08-10T10:29:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f0056d9d700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f00580ced00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0050009d90 tx=0x7f005000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d1bdcfaec5c84d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005559a700 1 -- 172.21.15.161:0/2747768415 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000e070 con 0x7f00580660d0 2023-08-10T10:29:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005559a700 1 -- 172.21.15.161:0/2747768415 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005000bbd0 con 0x7f00580660d0 2023-08-10T10:29:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005559a700 1 -- 172.21.15.161:0/2747768415 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050012430 con 0x7f00580660d0 2023-08-10T10:29:43.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 -- 172.21.15.161:0/2747768415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 msgr2=0x7f00580ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f00580ced00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0050009d90 tx=0x7f005000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 -- 172.21.15.161:0/2747768415 shutdown_connections 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f00580ced00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 --2- 172.21.15.161:0/2747768415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 -- 172.21.15.161:0/2747768415 >> 172.21.15.161:0/2747768415 conn(0x7f00580cf450 msgr2=0x7f00580cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 -- 172.21.15.161:0/2747768415 shutdown_connections 2023-08-10T10:29:43.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.877+0000 7f005cdc6700 1 -- 172.21.15.161:0/2747768415 wait complete. 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.879+0000 7f005cdc6700 1 Processor -- start 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.879+0000 7f005cdc6700 1 -- start start 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.879+0000 7f005cdc6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.879+0000 7f005cdc6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f005815b330 0x7f0058147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c33c0 con 0x7f00580660d0 2023-08-10T10:29:43.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058146560 con 0x7f005815b330 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0058146840 con 0x7f00580cd350 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32924/0 (socket says 172.21.15.161:32924) 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 -- 172.21.15.161:0/952893510 learned_addr learned my addr 172.21.15.161:0/952893510 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 -- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 msgr2=0x7f00580c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f0056d9d700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f005815b330 0x7f0058147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 -- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f005815b330 msgr2=0x7f0058147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f005815b330 0x7f0058147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 -- 172.21.15.161:0/952893510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009a70 con 0x7f00580660d0 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005659c700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011800 con 0x7f00580660d0 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c011960 con 0x7f00580660d0 2023-08-10T10:29:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0058146b20 con 0x7f00580660d0 2023-08-10T10:29:43.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011cf0 con 0x7f00580660d0 2023-08-10T10:29:43.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.880+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00581470e0 con 0x7f00580660d0 2023-08-10T10:29:43.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.881+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00580744e0 con 0x7f00580660d0 2023-08-10T10:29:43.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.882+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f004c018360 con 0x7f00580660d0 2023-08-10T10:29:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.882+0000 7f0046ffd700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 0x7f003806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.882+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f004c0894f0 con 0x7f00580660d0 2023-08-10T10:29:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.882+0000 7f0055d9b700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 0x7f003806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.882+0000 7f0055d9b700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 0x7f003806d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f005815a320 tx=0x7f00480079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:43.886+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f004c0545b0 con 0x7f00580660d0 2023-08-10T10:29:44.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.087+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00580ce7b0 con 0x7f00580660d0 2023-08-10T10:29:44.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.087+0000 7f0046ffd700 1 -- 172.21.15.161:0/952893510 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f004c057bd0 con 0x7f00580660d0 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 msgr2=0x7f003806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 0x7f003806d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f005815a320 tx=0x7f00480079f0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 msgr2=0x7f005815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00cbb0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 shutdown_connections 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f003806ace0 0x7f003806d1a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f005815b330 0x7f0058147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580660d0 0x7f005815e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 --2- 172.21.15.161:0/952893510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00580cd350 0x7f00580c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 >> 172.21.15.161:0/952893510 conn(0x7f00580cf450 msgr2=0x7f00580b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:44.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.089+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 shutdown_connections 2023-08-10T10:29:44.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.090+0000 7f005cdc6700 1 -- 172.21.15.161:0/952893510 wait complete. 2023-08-10T10:29:44.093 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-08-10T10:29:44.103 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:29:44.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:44.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-10T10:29:44.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:29:44.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:44.156 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:29:44.187 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:44.188 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:44.205 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:44.206 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:44.263 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:29:44.263 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:44.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:44.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.479+0000 7ff8586d3700 1 Processor -- start 2023-08-10T10:29:44.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.480+0000 7ff8586d3700 1 -- start start 2023-08-10T10:29:44.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.480+0000 7ff8586d3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff8500c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.480+0000 7ff8586d3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500cf6a0 con 0x7ff85006a190 2023-08-10T10:29:44.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff8586d3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85006ae60 con 0x7ff850071940 2023-08-10T10:29:44.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff8586d3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85006eb80 con 0x7ff8500aea70 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85646f700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff85006a190 0x7ff85006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38174/0 (socket says 172.21.15.161:38174) 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85646f700 1 -- 172.21.15.161:0/3442662715 learned_addr learned my addr 172.21.15.161:0/3442662715 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff855c6e700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff8500c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501335054 0 0) 0x7ff8500cf6a0 con 0x7ff85006a190 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c0035b0 con 0x7ff85006a190 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898451740 0 0) 0x7ff83c0035b0 con 0x7ff85006a190 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 msgr2=0x7ff8500c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:44.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff8500c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 >> v1:172.21.15.175:6789/0 conn(0x7ff850071940 legacy=0x7ff85006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85006e7a0 con 0x7ff85006a190 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7ff840001670 con 0x7ff85006a190 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 >> v1:172.21.15.161:6789/0 conn(0x7ff85006a190 legacy=0x7ff85006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff83c003a30 0x7ff83c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c0043e0 0x7ff83c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff83c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85006eb80 con 0x7ff83c003a30 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00ba10 con 0x7ff83c0043e0 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00bbd0 con 0x7ff8500aea70 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff85646f700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff83c003a30 0x7ff83c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.481+0000 7ff855c6e700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c0043e0 0x7ff83c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff856c70700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff83c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 -- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 msgr2=0x7ff83c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff83c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 -- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c0043e0 msgr2=0x7ff83c0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c0043e0 0x7ff83c0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 -- 172.21.15.161:0/3442662715 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0035b0 con 0x7ff83c003a30 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff856c70700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8500aea70 0x7ff83c005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85646f700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff83c003a30 0x7ff83c003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c2f0 tx=0x7ff83c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8389efdb9bcb994 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000ce30 con 0x7ff83c003a30 2023-08-10T10:29:44.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840005960 con 0x7ff83c003a30 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff85546d700 1 -- 172.21.15.161:0/3442662715 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840005cf0 con 0x7ff83c003a30 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff8586d3700 1 -- 172.21.15.161:0/3442662715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff83c003a30 msgr2=0x7ff83c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff8586d3700 1 --2- 172.21.15.161:0/3442662715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff83c003a30 0x7ff83c003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c2f0 tx=0x7ff83c005880 comp rx=0 tx=0).stop 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff856c70700 1 -- 172.21.15.161:0/3442662715 reap_dead start 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.482+0000 7ff8586d3700 1 -- 172.21.15.161:0/3442662715 shutdown_connections 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.483+0000 7ff8586d3700 1 -- 172.21.15.161:0/3442662715 >> 172.21.15.161:0/3442662715 conn(0x7ff8500cfd70 msgr2=0x7ff8500d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.483+0000 7ff8586d3700 1 -- 172.21.15.161:0/3442662715 shutdown_connections 2023-08-10T10:29:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.483+0000 7ff8586d3700 1 -- 172.21.15.161:0/3442662715 wait complete. 2023-08-10T10:29:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 Processor -- start 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 -- start start 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c003a30 0x7ff8501513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff850160110 0x7ff85015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85006ac80 con 0x7ff85015d920 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850160590 con 0x7ff850160110 2023-08-10T10:29:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.484+0000 7ff8586d3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501548f0 con 0x7ff83c003a30 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32950/0 (socket says 172.21.15.161:32950) 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 -- 172.21.15.161:0/2033438502 learned_addr learned my addr 172.21.15.161:0/2033438502 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff856c70700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff850160110 0x7ff85015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff85646f700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c003a30 0x7ff8501513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 -- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c003a30 msgr2=0x7ff8501513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c003a30 0x7ff8501513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 -- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff850160110 msgr2=0x7ff85015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff850160110 0x7ff85015e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 -- 172.21.15.161:0/2033438502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500ac840 con 0x7ff85015d920 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff855c6e700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0119c0 tx=0x7ff84c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c004240 con 0x7ff85015d920 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c0043a0 con 0x7ff85015d920 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff850154b40 con 0x7ff85015d920 2023-08-10T10:29:44.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00f730 con 0x7ff85015d920 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.485+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850155100 con 0x7ff85015d920 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.486+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8500acb20 con 0x7ff85015d920 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.487+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff84c00f890 con 0x7ff85015d920 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.487+0000 7ff846ffd700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 0x7ff83406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.487+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff84c089910 con 0x7ff85015d920 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.487+0000 7ff85646f700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 0x7ff83406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.487+0000 7ff85646f700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 0x7ff83406d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff840015040 tx=0x7ff840007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.491+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff84c0549c0 con 0x7ff85015d920 2023-08-10T10:29:44.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.687+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8500744e0 con 0x7ff85015d920 2023-08-10T10:29:44.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.688+0000 7ff846ffd700 1 -- 172.21.15.161:0/2033438502 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18374 (secure 0 0 0) 0x7ff84c019090 con 0x7ff85015d920 2023-08-10T10:29:44.690 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:44.690 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":25,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:44.524230+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:44.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 msgr2=0x7ff83406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 0x7ff83406d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff840015040 tx=0x7ff840007000 comp rx=0 tx=0).stop 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 msgr2=0x7ff85015fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0119c0 tx=0x7ff84c011d80 comp rx=0 tx=0).stop 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 shutdown_connections 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff83406ace0 0x7ff83406d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff850160110 0x7ff85015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c003a30 0x7ff8501513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 --2- 172.21.15.161:0/2033438502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85015d920 0x7ff85015fbd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 >> 172.21.15.161:0/2033438502 conn(0x7ff8500cfd70 msgr2=0x7ff85006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:44.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 shutdown_connections 2023-08-10T10:29:44.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.690+0000 7ff8586d3700 1 -- 172.21.15.161:0/2033438502 wait complete. 2023-08-10T10:29:44.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:44.705 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.826+0000 7f9510bda700 1 Processor -- start 2023-08-10T10:29:44.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.826+0000 7f9510bda700 1 -- start start 2023-08-10T10:29:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.827+0000 7f9510bda700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 0x7f950c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.827+0000 7f9510bda700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f950c0cffe0 0x7f950c0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.827+0000 7f9510bda700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c0c9cb0 con 0x7f950c15a170 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.827+0000 7f9510bda700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c0711e0 con 0x7f950c0cffe0 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.827+0000 7f9510bda700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c070ed0 con 0x7f950c15a550 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f950c0cffe0 0x7f950c0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f950c0cffe0 0x7f950c0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32960/0 (socket says 172.21.15.161:32960) 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950a59c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f950c15a170 0x7f950c0ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38194/0 (socket says 172.21.15.161:38194) 2023-08-10T10:29:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 -- 172.21.15.161:0/2099721234 learned_addr learned my addr 172.21.15.161:0/2099721234 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f9509d9b700 1 --2- 172.21.15.161:0/2099721234 >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 0x7f950c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 -- 172.21.15.161:0/2099721234 >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 msgr2=0x7f950c0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 --2- 172.21.15.161:0/2099721234 >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 0x7f950c0cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 -- 172.21.15.161:0/2099721234 >> v1:172.21.15.161:6789/0 conn(0x7f950c15a170 legacy=0x7f950c0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 -- 172.21.15.161:0/2099721234 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0c9f90 con 0x7f950c0cffe0 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950959a700 1 -- 172.21.15.161:0/2099721234 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377611743 0 0) 0x7f950c0c9cb0 con 0x7f950c15a170 2023-08-10T10:29:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f9509d9b700 1 --2- 172.21.15.161:0/2099721234 >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 0x7f950c0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950ad9d700 1 --2- 172.21.15.161:0/2099721234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c0cd3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f950c0b1fc0 tx=0x7f950400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc2d97dc5a5000 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950959a700 1 -- 172.21.15.161:0/2099721234 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504010070 con 0x7f950c0cffe0 2023-08-10T10:29:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950959a700 1 -- 172.21.15.161:0/2099721234 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950400dd90 con 0x7f950c0cffe0 2023-08-10T10:29:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.828+0000 7f950959a700 1 -- 172.21.15.161:0/2099721234 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400b310 con 0x7f950c0cffe0 2023-08-10T10:29:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 -- 172.21.15.161:0/2099721234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 msgr2=0x7f950c0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 --2- 172.21.15.161:0/2099721234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c0cd3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f950c0b1fc0 tx=0x7f950400d430 comp rx=0 tx=0).stop 2023-08-10T10:29:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 -- 172.21.15.161:0/2099721234 shutdown_connections 2023-08-10T10:29:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 --2- 172.21.15.161:0/2099721234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c0cd3c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 --2- 172.21.15.161:0/2099721234 >> v2:172.21.15.175:3300/0 conn(0x7f950c15a550 0x7f950c0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 -- 172.21.15.161:0/2099721234 >> 172.21.15.161:0/2099721234 conn(0x7f950c0cf4c0 msgr2=0x7f950c0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 -- 172.21.15.161:0/2099721234 shutdown_connections 2023-08-10T10:29:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.829+0000 7f9510bda700 1 -- 172.21.15.161:0/2099721234 wait complete. 2023-08-10T10:29:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.830+0000 7f9510bda700 1 Processor -- start 2023-08-10T10:29:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.830+0000 7f9510bda700 1 -- start start 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c15a170 0x7f950c0b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 0x7f950c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15b0f0 con 0x7f950c0cffe0 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0b2a50 con 0x7f950c15a550 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9510bda700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0b2ca0 con 0x7f950c15a170 2023-08-10T10:29:44.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32962/0 (socket says 172.21.15.161:32962) 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 -- 172.21.15.161:0/3698078650 learned_addr learned my addr 172.21.15.161:0/3698078650 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f9509d9b700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c15a170 0x7f950c0b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950ad9d700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 0x7f950c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 -- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c15a170 msgr2=0x7f950c0b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c15a170 0x7f950c0b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 -- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 msgr2=0x7f950c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 0x7f950c0b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950a59c700 1 -- 172.21.15.161:0/3698078650 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950400bd40 con 0x7f950c0cffe0 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.831+0000 7f950ad9d700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 0x7f950c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f950a59c700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f950000c750 tx=0x7f950000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500004c80 con 0x7f950c0cffe0 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500004e00 con 0x7f950c0cffe0 2023-08-10T10:29:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c0b2f80 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500007310 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.832+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c0b3540 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.833+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c0ca250 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.833+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9500007470 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.833+0000 7f94faffd700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 0x7f94ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.833+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f95000891d0 con 0x7f950c0cffe0 2023-08-10T10:29:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.833+0000 7f9509d9b700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 0x7f94ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:44.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.834+0000 7f9509d9b700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 0x7f94ec06d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c900 tx=0x7f94fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:44.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:44.838+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f950c0ca250 con 0x7f950c0cffe0 2023-08-10T10:29:45.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.022+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f950c0ca250 con 0x7f950c0cffe0 2023-08-10T10:29:45.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.023+0000 7f94faffd700 1 -- 172.21.15.161:0/3698078650 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f950c0ca250 con 0x7f950c0cffe0 2023-08-10T10:29:45.024 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:45.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.024+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 msgr2=0x7f94ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 0x7f94ec06d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c900 tx=0x7f94fc008040 comp rx=0 tx=0).stop 2023-08-10T10:29:45.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 msgr2=0x7f950c150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f950000c750 tx=0x7f950000cb10 comp rx=0 tx=0).stop 2023-08-10T10:29:45.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 shutdown_connections 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f94ec06ace0 0x7f94ec06d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c15a550 0x7f950c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f950c0cffe0 0x7f950c150d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 --2- 172.21.15.161:0/3698078650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c15a170 0x7f950c0b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 >> 172.21.15.161:0/3698078650 conn(0x7f950c0cf4c0 msgr2=0x7f950c155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 shutdown_connections 2023-08-10T10:29:45.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.025+0000 7f9510bda700 1 -- 172.21.15.161:0/3698078650 wait complete. 2023-08-10T10:29:45.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:45.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.160+0000 7fb8c055b700 1 Processor -- start 2023-08-10T10:29:45.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.160+0000 7fb8c055b700 1 -- start start 2023-08-10T10:29:45.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8b815e5e0 0x7fb8b80cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b80cb920 0x7fb8b80cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8b80cdc40 0x7fb8b80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b80ce0d0 con 0x7fb8b815e5e0 2023-08-10T10:29:45.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b815e9c0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8c055b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80cc1c0 con 0x7fb8b80cb920 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8b815e5e0 0x7fb8b80cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8b815e5e0 0x7fb8b80cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32970/0 (socket says 172.21.15.161:32970) 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 -- 172.21.15.161:0/3123735558 learned_addr learned my addr 172.21.15.161:0/3123735558 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8bdaf6700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b80cb920 0x7fb8b80cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8beaf8700 1 --2- 172.21.15.161:0/3123735558 >> v2:172.21.15.175:3300/0 conn(0x7fb8b80cdc40 0x7fb8b80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 -- 172.21.15.161:0/3123735558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b80cb920 msgr2=0x7fb8b80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b80cb920 0x7fb8b80cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 -- 172.21.15.161:0/3123735558 >> v2:172.21.15.175:3300/0 conn(0x7fb8b80cdc40 msgr2=0x7fb8b80ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/3123735558 >> v2:172.21.15.175:3300/0 conn(0x7fb8b80cdc40 0x7fb8b80ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 -- 172.21.15.161:0/3123735558 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80cc4a0 con 0x7fb8b815e5e0 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b815e5e0 0x7fb8b80cfa30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8b806dd30 tx=0x7fb8b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c277265b2f35d25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8bd2f5700 1 -- 172.21.15.161:0/3123735558 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400b870 con 0x7fb8b815e5e0 2023-08-10T10:29:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8bd2f5700 1 -- 172.21.15.161:0/3123735558 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b400b9d0 con 0x7fb8b815e5e0 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.161+0000 7fb8bd2f5700 1 -- 172.21.15.161:0/3123735558 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400bd60 con 0x7fb8b815e5e0 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 -- 172.21.15.161:0/3123735558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b815e5e0 msgr2=0x7fb8b80cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b815e5e0 0x7fb8b80cfa30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8b806dd30 tx=0x7fb8b4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 -- 172.21.15.161:0/3123735558 shutdown_connections 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 --2- 172.21.15.161:0/3123735558 >> v2:172.21.15.175:3300/0 conn(0x7fb8b80cdc40 0x7fb8b80ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b815e5e0 0x7fb8b80cfa30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 --2- 172.21.15.161:0/3123735558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b80cb920 0x7fb8b80cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 -- 172.21.15.161:0/3123735558 >> 172.21.15.161:0/3123735558 conn(0x7fb8b809a140 msgr2=0x7fb8b80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 -- 172.21.15.161:0/3123735558 shutdown_connections 2023-08-10T10:29:45.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.162+0000 7fb8c055b700 1 -- 172.21.15.161:0/3123735558 wait complete. 2023-08-10T10:29:45.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.163+0000 7fb8c055b700 1 Processor -- start 2023-08-10T10:29:45.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.163+0000 7fb8c055b700 1 -- start start 2023-08-10T10:29:45.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b80cb920 0x7fb8b80ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 0x7fb8b80c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80af3f0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80c4c60 con 0x7fb8b80cb920 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8c055b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80ade10 con 0x7fb8b815e5e0 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32978/0 (socket says 172.21.15.161:32978) 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 -- 172.21.15.161:0/2574014023 learned_addr learned my addr 172.21.15.161:0/2574014023 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b80cb920 0x7fb8b80ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8beaf8700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 0x7fb8b80c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 -- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 msgr2=0x7fb8b80c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 0x7fb8b80c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 -- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b80cb920 msgr2=0x7fb8b80ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b80cb920 0x7fb8b80ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8bdaf6700 1 -- 172.21.15.161:0/2574014023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009550 con 0x7fb8b80cdc40 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.164+0000 7fb8beaf8700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 0x7fb8b80c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8bdaf6700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800d800 tx=0x7fb8a800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80125f0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8012750 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b80ae0f0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8012b00 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.165+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b80ae6b0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.166+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b804ecc0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.166+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8a8012c60 con 0x7fb8b80cdc40 2023-08-10T10:29:45.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.167+0000 7fb8aeffd700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 0x7fb89c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.167+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb8a808a2b0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.167+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 0x7fb89c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.167+0000 7fb8be2f7700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 0x7fb89c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000c00 tx=0x7fb8b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.170+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb8a8055320 con 0x7fb8b80cdc40 2023-08-10T10:29:45.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.357+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8b80b12c0 con 0x7fb8b80cdc40 2023-08-10T10:29:45.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.358+0000 7fb8aeffd700 1 -- 172.21.15.161:0/2574014023 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8a8058940 con 0x7fb8b80cdc40 2023-08-10T10:29:45.359 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.359+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 msgr2=0x7fb89c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.359+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 0x7fb89c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000c00 tx=0x7fb8b4008030 comp rx=0 tx=0).stop 2023-08-10T10:29:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.359+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 msgr2=0x7fb8b80aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.359+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800d800 tx=0x7fb8a800db10 comp rx=0 tx=0).stop 2023-08-10T10:29:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.359+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 shutdown_connections 2023-08-10T10:29:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb89c06ace0 0x7fb89c06d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b815e5e0 0x7fb8b80c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b80cb920 0x7fb8b80ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 --2- 172.21.15.161:0/2574014023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8b80cdc40 0x7fb8b80aeeb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 >> 172.21.15.161:0/2574014023 conn(0x7fb8b809a140 msgr2=0x7fb8b80b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 shutdown_connections 2023-08-10T10:29:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.360+0000 7fb8c055b700 1 -- 172.21.15.161:0/2574014023 wait complete. 2023-08-10T10:29:45.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:45.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 Processor -- start 2023-08-10T10:29:45.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 -- start start 2023-08-10T10:29:45.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7b015e4f0 0x7fb7b00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b015abb0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b015ae90 con 0x7fb7b00b1740 2023-08-10T10:29:45.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.497+0000 7fb7b5f93700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b015b170 con 0x7fb7b015e4f0 2023-08-10T10:29:45.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7af7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb7b0159fd0 0x7fb7b015a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38222/0 (socket says 172.21.15.161:38222) 2023-08-10T10:29:45.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7af7fe700 1 -- 172.21.15.161:0/3197197309 learned_addr learned my addr 172.21.15.161:0/3197197309 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:45.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7aeffd700 1 --2- 172.21.15.161:0/3197197309 >> v2:172.21.15.175:3300/0 conn(0x7fb7b015e4f0 0x7fb7b00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276645686 0 0) 0x7fb7b015abb0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7980035b0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284454800 0 0) 0x7fb7980035b0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7aeffd700 1 -- 172.21.15.161:0/3197197309 >> v1:172.21.15.175:6789/0 conn(0x7fb7b00b1740 legacy=0x7fb7b00cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7aeffd700 1 -- 172.21.15.161:0/3197197309 >> v1:172.21.15.161:6789/0 conn(0x7fb7b0159fd0 legacy=0x7fb7b015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7aeffd700 1 -- 172.21.15.161:0/3197197309 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b00cac90 con 0x7fb7b015e4f0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7aeffd700 1 --2- 172.21.15.161:0/3197197309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00cdaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009840 tx=0x7fb7a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcbe611c3abd1aa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4001670 con 0x7fb7b015e4f0 2023-08-10T10:29:45.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0004030 con 0x7fb7b015e4f0 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.498+0000 7fb7ae7fc700 1 -- 172.21.15.161:0/3197197309 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00043a0 con 0x7fb7b015e4f0 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 -- 172.21.15.161:0/3197197309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 msgr2=0x7fb7b00cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/3197197309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00cdaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009840 tx=0x7fb7a0009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 -- 172.21.15.161:0/3197197309 shutdown_connections 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/3197197309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00cdaa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 -- 172.21.15.161:0/3197197309 >> 172.21.15.161:0/3197197309 conn(0x7fb7b00cc740 msgr2=0x7fb7b00ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 -- 172.21.15.161:0/3197197309 shutdown_connections 2023-08-10T10:29:45.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.499+0000 7fb7b5f93700 1 -- 172.21.15.161:0/3197197309 wait complete. 2023-08-10T10:29:45.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.500+0000 7fb7b5f93700 1 Processor -- start 2023-08-10T10:29:45.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.500+0000 7fb7b5f93700 1 -- start start 2023-08-10T10:29:45.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7b00b1740 0x7fb7b0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b0155980 con 0x7fb7b0159fd0 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01f0860 con 0x7fb7b015e4f0 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7b5f93700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01f0ad0 con 0x7fb7b00b1740 2023-08-10T10:29:45.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7aeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7aeffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:32992/0 (socket says 172.21.15.161:32992) 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7aeffd700 1 -- 172.21.15.161:0/1071166897 learned_addr learned my addr 172.21.15.161:0/1071166897 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7affff700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.501+0000 7fb7af7fe700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7b00b1740 0x7fb7b0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 -- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7b00b1740 msgr2=0x7fb7b0155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7b00b1740 0x7fb7b0155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 -- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 msgr2=0x7fb7b00b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 -- 172.21.15.161:0/1071166897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a00094a0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7aeffd700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0070670 tx=0x7fb7a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0003db0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a001f070 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01f0db0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0011830 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.502+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b015dc60 con 0x7fb7b0159fd0 2023-08-10T10:29:45.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.503+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b01f12d0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.503+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7a0021030 con 0x7fb7b0159fd0 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.504+0000 7fb797fff700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 0x7fb79c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.504+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb7a008a9f0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.504+0000 7fb7af7fe700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 0x7fb79c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.504+0000 7fb7af7fe700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 0x7fb79c06d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001eb0 tx=0x7fb7a4001c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.509+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb7b01f12d0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.700+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7b01f12d0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.701+0000 7fb797fff700 1 -- 172.21.15.161:0/1071166897 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7b01f12d0 con 0x7fb7b0159fd0 2023-08-10T10:29:45.702 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:45.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 msgr2=0x7fb79c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 0x7fb79c06d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001eb0 tx=0x7fb7a4001c60 comp rx=0 tx=0).stop 2023-08-10T10:29:45.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 msgr2=0x7fb7b00b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0070670 tx=0x7fb7a0004750 comp rx=0 tx=0).stop 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 shutdown_connections 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb79c06ace0 0x7fb79c06d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b015e4f0 0x7fb7b00b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7b00b1740 0x7fb7b0155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 --2- 172.21.15.161:0/1071166897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7b0159fd0 0x7fb7b00b47b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 >> 172.21.15.161:0/1071166897 conn(0x7fb7b00cc740 msgr2=0x7fb7b0073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 shutdown_connections 2023-08-10T10:29:45.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.703+0000 7fb7b5f93700 1 -- 172.21.15.161:0/1071166897 wait complete. 2023-08-10T10:29:45.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:45.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.838+0000 7ff510f76700 1 Processor -- start 2023-08-10T10:29:45.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.838+0000 7ff510f76700 1 -- start start 2023-08-10T10:29:45.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff510f76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff50c0cb9f0 0x7ff50c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff510f76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff50c06a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff510f76700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c06ab00 con 0x7ff50c160d20 2023-08-10T10:29:45.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff510f76700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c071950 con 0x7ff50c0cb9f0 2023-08-10T10:29:45.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff510f76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0b2660 con 0x7ff50c06a190 2023-08-10T10:29:45.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff509d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff50c160d20 0x7ff50c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38236/0 (socket says 172.21.15.161:38236) 2023-08-10T10:29:45.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff509d9b700 1 -- 172.21.15.161:0/2559384361 learned_addr learned my addr 172.21.15.161:0/2559384361 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:45.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50ad9d700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff50c06a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50a59c700 1 --2- 172.21.15.161:0/2559384361 >> v2:172.21.15.175:3300/0 conn(0x7ff50c0cb9f0 0x7ff50c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704509526 0 0) 0x7ff50c06ab00 con 0x7ff50c160d20 2023-08-10T10:29:45.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f40035b0 con 0x7ff50c160d20 2023-08-10T10:29:45.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167323228 0 0) 0x7ff4f40035b0 con 0x7ff50c160d20 2023-08-10T10:29:45.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 msgr2=0x7ff50c06a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff50c06a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 >> v2:172.21.15.175:3300/0 conn(0x7ff50c0cb9f0 msgr2=0x7ff50c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 --2- 172.21.15.161:0/2559384361 >> v2:172.21.15.175:3300/0 conn(0x7ff50c0cb9f0 0x7ff50c0b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.839+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c06dc10 con 0x7ff50c160d20 2023-08-10T10:29:45.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7ff4fc001670 con 0x7ff50c160d20 2023-08-10T10:29:45.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 >> v1:172.21.15.161:6789/0 conn(0x7ff50c160d20 legacy=0x7ff50c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f4003a00 0x7ff4f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff4f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4004d90 0x7ff4f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c071950 con 0x7ff4f4003a00 2023-08-10T10:29:45.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0b2660 con 0x7ff4f4004d90 2023-08-10T10:29:45.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f400ba10 con 0x7ff50c06a190 2023-08-10T10:29:45.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f4003a00 0x7ff4f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff509d9b700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff4f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50ad9d700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4004d90 0x7ff4f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 -- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 msgr2=0x7ff4f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c06a190 0x7ff4f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 -- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4004d90 msgr2=0x7ff4f4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:45.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4004d90 0x7ff4f4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 -- 172.21.15.161:0/2559384361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40035b0 con 0x7ff4f4003a00 2023-08-10T10:29:45.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50a59c700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f4003a00 0x7ff4f4003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff500009b60 tx=0x7ff4f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c791afcc3d15922a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000e6c0 con 0x7ff4f4003a00 2023-08-10T10:29:45.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000e820 con 0x7ff4f4003a00 2023-08-10T10:29:45.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.840+0000 7ff50959a700 1 -- 172.21.15.161:0/2559384361 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000eb90 con 0x7ff4f4003a00 2023-08-10T10:29:45.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 -- 172.21.15.161:0/2559384361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f4003a00 msgr2=0x7ff4f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 --2- 172.21.15.161:0/2559384361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f4003a00 0x7ff4f4003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff500009b60 tx=0x7ff4f4005880 comp rx=0 tx=0).stop 2023-08-10T10:29:45.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff50ad9d700 1 -- 172.21.15.161:0/2559384361 reap_dead start 2023-08-10T10:29:45.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 -- 172.21.15.161:0/2559384361 shutdown_connections 2023-08-10T10:29:45.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 -- 172.21.15.161:0/2559384361 >> 172.21.15.161:0/2559384361 conn(0x7ff50c0cc740 msgr2=0x7ff50c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:45.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 -- 172.21.15.161:0/2559384361 shutdown_connections 2023-08-10T10:29:45.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.841+0000 7ff510f76700 1 -- 172.21.15.161:0/2559384361 wait complete. 2023-08-10T10:29:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.842+0000 7ff510f76700 1 Processor -- start 2023-08-10T10:29:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.842+0000 7ff510f76700 1 -- start start 2023-08-10T10:29:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 0x7ff50c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 0x7ff50c14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c14acd0 con 0x7ff50c157e30 2023-08-10T10:29:45.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c5040 con 0x7ff4f4003a00 2023-08-10T10:29:45.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff510f76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c52e0 con 0x7ff50c0c6380 2023-08-10T10:29:45.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33014/0 (socket says 172.21.15.161:33014) 2023-08-10T10:29:45.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 -- 172.21.15.161:0/3202138713 learned_addr learned my addr 172.21.15.161:0/3202138713 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:45.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff509d9b700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 0x7ff50c14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50a59c700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 0x7ff50c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 -- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 msgr2=0x7ff50c14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 0x7ff50c14a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 -- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 msgr2=0x7ff50c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:45.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 0x7ff50c0b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:45.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50ad9d700 1 -- 172.21.15.161:0/3202138713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0c55c0 con 0x7ff50c157e30 2023-08-10T10:29:45.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff509d9b700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 0x7ff50c14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.843+0000 7ff50a59c700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 0x7ff50c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff50ad9d700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff50c070620 tx=0x7ff5040114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400e070 con 0x7ff50c157e30 2023-08-10T10:29:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504003c30 con 0x7ff50c157e30 2023-08-10T10:29:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c0c58a0 con 0x7ff50c157e30 2023-08-10T10:29:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504003e20 con 0x7ff50c157e30 2023-08-10T10:29:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.844+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c0c5e60 con 0x7ff50c157e30 2023-08-10T10:29:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.845+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c04ecc0 con 0x7ff50c157e30 2023-08-10T10:29:45.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.845+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff504011a10 con 0x7ff50c157e30 2023-08-10T10:29:45.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.846+0000 7ff4faffd700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 0x7ff4ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:45.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.846+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff504089880 con 0x7ff50c157e30 2023-08-10T10:29:45.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.846+0000 7ff50a59c700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 0x7ff4ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:45.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.846+0000 7ff50a59c700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 0x7ff4ec06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5000090b0 tx=0x7ff500008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:45.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:45.851+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff504054980 con 0x7ff50c157e30 2023-08-10T10:29:46.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.038+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff50c0713d0 con 0x7ff50c157e30 2023-08-10T10:29:46.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.039+0000 7ff4faffd700 1 -- 172.21.15.161:0/3202138713 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff504057fa0 con 0x7ff50c157e30 2023-08-10T10:29:46.041 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:46.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 msgr2=0x7ff4ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 0x7ff4ec06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5000090b0 tx=0x7ff500008030 comp rx=0 tx=0).stop 2023-08-10T10:29:46.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 msgr2=0x7ff50c0acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff50c070620 tx=0x7ff5040114b0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 shutdown_connections 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff4ec06ace0 0x7ff4ec06d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff50c157e30 0x7ff50c0acb30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f4003a00 0x7ff50c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 --2- 172.21.15.161:0/3202138713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff50c0c6380 0x7ff50c14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 >> 172.21.15.161:0/3202138713 conn(0x7ff50c0cc740 msgr2=0x7ff50c15fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:46.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 shutdown_connections 2023-08-10T10:29:46.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.041+0000 7ff510f76700 1 -- 172.21.15.161:0/3202138713 wait complete. 2023-08-10T10:29:46.055 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:29:46.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 Processor -- start 2023-08-10T10:29:46.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 -- start start 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03280cd7e0 0x7f03280cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03280c52c0 0x7f03280c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03280cc780 con 0x7f032815b050 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03280ccd40 con 0x7f03280cd7e0 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032f8f3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03280ce1d0 con 0x7f03280c52c0 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03280cd7e0 0x7f03280cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032d68f700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f032815b050 0x7f03280d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38256/0 (socket says 172.21.15.161:38256) 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032d68f700 1 -- 172.21.15.161:0/3000050198 learned_addr learned my addr 172.21.15.161:0/3000050198 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032de90700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03280c52c0 0x7f03280c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 -- 172.21.15.161:0/3000050198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03280c52c0 msgr2=0x7f03280c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03280c52c0 0x7f03280c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 -- 172.21.15.161:0/3000050198 >> v1:172.21.15.161:6789/0 conn(0x7f032815b050 legacy=0x7f03280d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 -- 172.21.15.161:0/3000050198 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03280cca60 con 0x7f03280cd7e0 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f031ffff700 1 -- 172.21.15.161:0/3000050198 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291358877 0 0) 0x7f03280cc780 con 0x7f032815b050 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f032ce8e700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280cd7e0 0x7f03280cdc90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0318009840 tx=0x7f0318009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289ce02d8410c29c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.177+0000 7f031ffff700 1 -- 172.21.15.161:0/3000050198 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318011830 con 0x7f03280cd7e0 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f031ffff700 1 -- 172.21.15.161:0/3000050198 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0318011990 con 0x7f03280cd7e0 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f031ffff700 1 -- 172.21.15.161:0/3000050198 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318011d20 con 0x7f03280cd7e0 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 -- 172.21.15.161:0/3000050198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280cd7e0 msgr2=0x7f03280cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280cd7e0 0x7f03280cdc90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0318009840 tx=0x7f0318009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 -- 172.21.15.161:0/3000050198 shutdown_connections 2023-08-10T10:29:46.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03280c52c0 0x7f03280c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 --2- 172.21.15.161:0/3000050198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280cd7e0 0x7f03280cdc90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 -- 172.21.15.161:0/3000050198 >> 172.21.15.161:0/3000050198 conn(0x7f032809a150 msgr2=0x7f03280d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:46.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 -- 172.21.15.161:0/3000050198 shutdown_connections 2023-08-10T10:29:46.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.178+0000 7f032f8f3700 1 -- 172.21.15.161:0/3000050198 wait complete. 2023-08-10T10:29:46.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.179+0000 7f032f8f3700 1 Processor -- start 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.179+0000 7f032f8f3700 1 -- start start 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 0x7f03280c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f032815b050 0x7f03281e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280b39e0 con 0x7f03280c52c0 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032814ffb0 con 0x7f03280cd7e0 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032f8f3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03280b4cd0 con 0x7f032815b050 2023-08-10T10:29:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032d68f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032d68f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33026/0 (socket says 172.21.15.161:33026) 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032d68f700 1 -- 172.21.15.161:0/4090977850 learned_addr learned my addr 172.21.15.161:0/4090977850 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032de90700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f032815b050 0x7f03281e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.180+0000 7f032ce8e700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 0x7f03280c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 -- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f032815b050 msgr2=0x7f03281e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f032815b050 0x7f03281e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 -- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 msgr2=0x7f03280c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 0x7f03280c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 -- 172.21.15.161:0/4090977850 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180094a0 con 0x7f03280c52c0 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032ce8e700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 0x7f03280c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032d68f700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03240010e0 tx=0x7f032400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240074e0 con 0x7f03280c52c0 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324007640 con 0x7f03280c52c0 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03280b3c30 con 0x7f03280c52c0 2023-08-10T10:29:46.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324005a70 con 0x7f03280c52c0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.181+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03280b41f0 con 0x7f03280c52c0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.182+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03280cfc50 con 0x7f03280c52c0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.182+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0324005bd0 con 0x7f03280c52c0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.183+0000 7f031dffb700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 0x7f030c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.183+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03240889c0 con 0x7f03280c52c0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.183+0000 7f032ce8e700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 0x7f030c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.183+0000 7f032ce8e700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 0x7f030c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03180090b0 tx=0x7f0318008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.188+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0324053a30 con 0x7f03280c52c0 2023-08-10T10:29:46.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.390+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03280744e0 con 0x7f03280c52c0 2023-08-10T10:29:46.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.391+0000 7f031dffb700 1 -- 172.21.15.161:0/4090977850 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0324017080 con 0x7f03280c52c0 2023-08-10T10:29:46.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 msgr2=0x7f030c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 0x7f030c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03180090b0 tx=0x7f0318008030 comp rx=0 tx=0).stop 2023-08-10T10:29:46.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 msgr2=0x7f032814fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03240010e0 tx=0x7f032400ca30 comp rx=0 tx=0).stop 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 shutdown_connections 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f030c06ace0 0x7f030c06d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f032815b050 0x7f03281e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03280c52c0 0x7f032814fa70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 --2- 172.21.15.161:0/4090977850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03280cd7e0 0x7f03280c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 >> 172.21.15.161:0/4090977850 conn(0x7f032809a150 msgr2=0x7f03280b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 shutdown_connections 2023-08-10T10:29:46.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.393+0000 7f032f8f3700 1 -- 172.21.15.161:0/4090977850 wait complete. 2023-08-10T10:29:46.396 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-08-10T10:29:46.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-10T10:29:46.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:46.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-10T10:29:46.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T10:29:46.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:46.446 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-10T10:29:46.503 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:46.503 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:46.524 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:46.524 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:46.584 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T10:29:46.584 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:29:46.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.763+0000 7f6060c76700 1 Processor -- start 2023-08-10T10:29:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.763+0000 7f6060c76700 1 -- start start 2023-08-10T10:29:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f6060c76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f605c15acd0 0x7f605c06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f6060c76700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c071ee0 con 0x7f605c154620 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f6060c76700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c15b290 con 0x7f605c06df40 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f6060c76700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c0c5890 con 0x7f605c15acd0 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f605a59c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f605c154620 0x7f605c0717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38270/0 (socket says 172.21.15.161:38270) 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.764+0000 7f605a59c700 1 -- 172.21.15.161:0/940973990 learned_addr learned my addr 172.21.15.161:0/940973990 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445834337 0 0) 0x7f605c071ee0 con 0x7f605c154620 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60440035b0 con 0x7f605c154620 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605ad9d700 1 --2- 172.21.15.161:0/940973990 >> v2:172.21.15.175:3300/0 conn(0x7f605c15acd0 0x7f605c06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4001298572 0 0) 0x7f60440035b0 con 0x7f605c154620 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 >> v2:172.21.15.175:3300/0 conn(0x7f605c15acd0 msgr2=0x7f605c06e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 --2- 172.21.15.161:0/940973990 >> v2:172.21.15.175:3300/0 conn(0x7f605c15acd0 0x7f605c06e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 >> v1:172.21.15.175:6789/0 conn(0x7f605c06df40 legacy=0x7f605c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c15b570 con 0x7f605c154620 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f6050001670 con 0x7f605c154620 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 >> v1:172.21.15.161:6789/0 conn(0x7f605c154620 legacy=0x7f605c0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 0x7f6044003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044004850 0x7f6044004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6044005210 0x7f604400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0c5890 con 0x7f6044003a00 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604400c160 con 0x7f6044005210 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604400c320 con 0x7f6044004850 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 0x7f6044003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f6059d9b700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044004850 0x7f6044004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605ad9d700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6044005210 0x7f604400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 -- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044004850 msgr2=0x7f6044004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044004850 0x7f6044004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 -- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6044005210 msgr2=0x7f604400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6044005210 0x7f604400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 -- 172.21.15.161:0/940973990 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440035b0 con 0x7f6044003a00 2023-08-10T10:29:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605ad9d700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6044005210 0x7f604400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605ad9d700 1 -- 172.21.15.161:0/940973990 reap_dead start 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.765+0000 7f605a59c700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 0x7f6044003e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f605000c240 tx=0x7f6044005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4722a133491641 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050007c10 con 0x7f6044003a00 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605000ce00 con 0x7f6044003a00 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f605959a700 1 -- 172.21.15.161:0/940973990 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050005ba0 con 0x7f6044003a00 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 -- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 msgr2=0x7f6044003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 0x7f6044003e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f605000c240 tx=0x7f6044005880 comp rx=0 tx=0).stop 2023-08-10T10:29:46.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 -- 172.21.15.161:0/940973990 shutdown_connections 2023-08-10T10:29:46.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 --2- 172.21.15.161:0/940973990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6044003a00 0x7f6044003e20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 -- 172.21.15.161:0/940973990 >> 172.21.15.161:0/940973990 conn(0x7f605c0cfd70 msgr2=0x7f605c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:46.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 -- 172.21.15.161:0/940973990 shutdown_connections 2023-08-10T10:29:46.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.766+0000 7f6060c76700 1 -- 172.21.15.161:0/940973990 wait complete. 2023-08-10T10:29:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.767+0000 7f6060c76700 1 Processor -- start 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 -- start start 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044003a00 0x7f605c1f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c154a00 0x7f605c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1588b0 con 0x7f605c156830 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c157220 con 0x7f605c154a00 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6060c76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c155a80 con 0x7f6044003a00 2023-08-10T10:29:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33048/0 (socket says 172.21.15.161:33048) 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f605ad9d700 1 -- 172.21.15.161:0/2866982493 learned_addr learned my addr 172.21.15.161:0/2866982493 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f6059d9b700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c154a00 0x7f605c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.768+0000 7f605a59c700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044003a00 0x7f605c1f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 -- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044003a00 msgr2=0x7f605c1f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044003a00 0x7f605c1f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 -- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c154a00 msgr2=0x7f605c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c154a00 0x7f605c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 -- 172.21.15.161:0/2866982493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c154f00 con 0x7f605c156830 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f605ad9d700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f605c0c5160 tx=0x7f6054004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540078c0 con 0x7f605c156830 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605400f050 con 0x7f605c156830 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c1551e0 con 0x7f605c156830 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054007c80 con 0x7f605c156830 2023-08-10T10:29:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.769+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c1557a0 con 0x7f605c156830 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.770+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c0744e0 con 0x7f605c156830 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.770+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f605401d410 con 0x7f605c156830 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.771+0000 7f604affd700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 0x7f603c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.771+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f60540896a0 con 0x7f605c156830 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.771+0000 7f605a59c700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 0x7f603c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.771+0000 7f605a59c700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 0x7f603c06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6050000c00 tx=0x7f6050007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.775+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60540581a0 con 0x7f605c156830 2023-08-10T10:29:46.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.963+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f605c0cf990 con 0x7f605c156830 2023-08-10T10:29:46.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.964+0000 7f604affd700 1 -- 172.21.15.161:0/2866982493 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f6054007250 con 0x7f605c156830 2023-08-10T10:29:46.965 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:46.965 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:45.529227+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:46.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 msgr2=0x7f603c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 0x7f603c06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6050000c00 tx=0x7f6050007000 comp rx=0 tx=0).stop 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 msgr2=0x7f605c156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f605c0c5160 tx=0x7f6054004690 comp rx=0 tx=0).stop 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 shutdown_connections 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f603c06ace0 0x7f603c06d1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f605c156830 0x7f605c156ce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6044003a00 0x7f605c1f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 --2- 172.21.15.161:0/2866982493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c154a00 0x7f605c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 >> 172.21.15.161:0/2866982493 conn(0x7f605c0cfd70 msgr2=0x7f605c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 shutdown_connections 2023-08-10T10:29:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:46.966+0000 7f6060c76700 1 -- 172.21.15.161:0/2866982493 wait complete. 2023-08-10T10:29:46.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:46.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.102+0000 7f9ef3bdf700 1 Processor -- start 2023-08-10T10:29:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.103+0000 7f9ef3bdf700 1 -- start start 2023-08-10T10:29:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.103+0000 7f9ef3bdf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec15e5e0 0x7f9eec0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.103+0000 7f9ef3bdf700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec15e9c0 con 0x7f9eec0cb920 2023-08-10T10:29:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.103+0000 7f9ef3bdf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0cc1c0 con 0x7f9eec0cde10 2023-08-10T10:29:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.103+0000 7f9ef3bdf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0cc4a0 con 0x7f9eec15e5e0 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef117a700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9eec0cb920 0x7f9eec0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38290/0 (socket says 172.21.15.161:38290) 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef117a700 1 -- 172.21.15.161:0/2483002243 learned_addr learned my addr 172.21.15.161:0/2483002243 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef197b700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec15e5e0 0x7f9eec0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315374513 0 0) 0x7f9eec15e9c0 con 0x7f9eec0cb920 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed80035b0 con 0x7f9eec0cb920 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582715944 0 0) 0x7f9eec0cc1c0 con 0x7f9eec0cde10 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eec15e9c0 con 0x7f9eec0cde10 2023-08-10T10:29:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077667333 0 0) 0x7f9ed80035b0 con 0x7f9eec0cb920 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec15e5e0 msgr2=0x7f9eec0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec15e5e0 0x7f9eec0cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 >> v1:172.21.15.175:6789/0 conn(0x7f9eec0cde10 legacy=0x7f9eec0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0cc780 con 0x7f9eec0cb920 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f9ee8001670 con 0x7f9eec0cb920 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 >> v1:172.21.15.161:6789/0 conn(0x7f9eec0cb920 legacy=0x7f9eec0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed8003bc0 0x7f9ed8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8004850 0x7f9ed8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ed8005210 0x7f9ed800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0cc4a0 con 0x7f9ed8005210 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed800c000 con 0x7f9ed8004850 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed800c1c0 con 0x7f9ed8003bc0 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef197b700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec15e5e0 0x7f9eec0cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef217c700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ed8005210 0x7f9ed800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef117a700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8004850 0x7f9ed8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.104+0000 7f9ef197b700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed8003bc0 0x7f9ed8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 -- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed8003bc0 msgr2=0x7f9ed8003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed8003bc0 0x7f9ed8003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 -- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8004850 msgr2=0x7f9ed8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8004850 0x7f9ed8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 -- 172.21.15.161:0/2483002243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80035b0 con 0x7f9ed8005210 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef197b700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed8003bc0 0x7f9ed8003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ed8005210 0x7f9ed800ba10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0ce8e0 tx=0x7f9ed8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea4b129a2451bd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4001f20 con 0x7f9ed8005210 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee400ce40 con 0x7f9ed8005210 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef0979700 1 -- 172.21.15.161:0/2483002243 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003c40 con 0x7f9ed8005210 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/2483002243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ed8005210 msgr2=0x7f9ed800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/2483002243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ed8005210 0x7f9ed800ba10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0ce8e0 tx=0x7f9ed8005880 comp rx=0 tx=0).stop 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef217c700 1 -- 172.21.15.161:0/2483002243 reap_dead start 2023-08-10T10:29:47.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/2483002243 shutdown_connections 2023-08-10T10:29:47.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/2483002243 >> 172.21.15.161:0/2483002243 conn(0x7f9eec09a140 msgr2=0x7f9eec0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/2483002243 shutdown_connections 2023-08-10T10:29:47.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.105+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/2483002243 wait complete. 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 Processor -- start 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 -- start start 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8005210 0x7f9eec0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec0b07d0 0x7f9eec0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0b2c00 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0b4780 con 0x7f9ed8005210 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef3bdf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0c8370 con 0x7f9eec0b07d0 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef117a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef117a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33064/0 (socket says 172.21.15.161:33064) 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.107+0000 7f9ef117a700 1 -- 172.21.15.161:0/914388269 learned_addr learned my addr 172.21.15.161:0/914388269 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef197b700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8005210 0x7f9eec0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 -- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec0b07d0 msgr2=0x7f9eec0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec0b07d0 0x7f9eec0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 -- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8005210 msgr2=0x7f9eec0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8005210 0x7f9eec0b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 -- 172.21.15.161:0/914388269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0c8650 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef117a700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80072c0 tx=0x7f9ee8007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80077a0 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800f870 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800fc20 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0c8930 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.108+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec0b23c0 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.109+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec06a4a0 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.109+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ee800fd80 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.110+0000 7f9ee27fc700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 0x7f9ed006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.110+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9ee8089510 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.110+0000 7f9ef197b700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 0x7f9ed006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.110+0000 7f9ef197b700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 0x7f9ed006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9eec070300 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.114+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9ee8054580 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.302+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eec0b48c0 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.303+0000 7f9ee27fc700 1 -- 172.21.15.161:0/914388269 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ee8057ba0 con 0x7f9eec0c7eb0 2023-08-10T10:29:47.304 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:47.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 msgr2=0x7f9ed006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 0x7f9ed006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9eec070300 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2023-08-10T10:29:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 msgr2=0x7f9eec15a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80072c0 tx=0x7f9ee8007680 comp rx=0 tx=0).stop 2023-08-10T10:29:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 shutdown_connections 2023-08-10T10:29:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f9ed006ace0 0x7f9ed006d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec0b07d0 0x7f9eec0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed8005210 0x7f9eec0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 --2- 172.21.15.161:0/914388269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9eec0c7eb0 0x7f9eec15a340 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 >> 172.21.15.161:0/914388269 conn(0x7f9eec09a140 msgr2=0x7f9eec0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 shutdown_connections 2023-08-10T10:29:47.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.305+0000 7f9ef3bdf700 1 -- 172.21.15.161:0/914388269 wait complete. 2023-08-10T10:29:47.317 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:47.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.440+0000 7f5b80c1e700 1 Processor -- start 2023-08-10T10:29:47.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.440+0000 7f5b80c1e700 1 -- start start 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b80c1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b80c1e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b80c1e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c06dc10 con 0x7f5b7c0cf730 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b80c1e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c071950 con 0x7f5b7c160d20 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b80c1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0cfb80 con 0x7f5b7c0cb9f0 2023-08-10T10:29:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33074/0 (socket says 172.21.15.161:33074) 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 -- 172.21.15.161:0/1755714188 learned_addr learned my addr 172.21.15.161:0/1755714188 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b7a59c700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 -- 172.21.15.161:0/1755714188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 msgr2=0x7f5b7c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 -- 172.21.15.161:0/1755714188 >> v1:172.21.15.175:6789/0 conn(0x7f5b7c0cf730 legacy=0x7f5b7c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 -- 172.21.15.161:0/1755714188 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c06dff0 con 0x7f5b7c160d20 2023-08-10T10:29:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b79d9b700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5b700098f0 tx=0x7f5b70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65df8ff2d94a6456 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b7959a700 1 -- 172.21.15.161:0/1755714188 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70004230 con 0x7f5b7c160d20 2023-08-10T10:29:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.441+0000 7f5b7959a700 1 -- 172.21.15.161:0/1755714188 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70004390 con 0x7f5b7c160d20 2023-08-10T10:29:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b7959a700 1 -- 172.21.15.161:0/1755714188 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700036a0 con 0x7f5b7c160d20 2023-08-10T10:29:47.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 -- 172.21.15.161:0/1755714188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 msgr2=0x7f5b7c0cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5b700098f0 tx=0x7f5b70009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:47.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 -- 172.21.15.161:0/1755714188 shutdown_connections 2023-08-10T10:29:47.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/1755714188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0cf1f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 -- 172.21.15.161:0/1755714188 >> 172.21.15.161:0/1755714188 conn(0x7f5b7c0cc740 msgr2=0x7f5b7c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 -- 172.21.15.161:0/1755714188 shutdown_connections 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.442+0000 7f5b80c1e700 1 -- 172.21.15.161:0/1755714188 wait complete. 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.443+0000 7f5b80c1e700 1 Processor -- start 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.443+0000 7f5b80c1e700 1 -- start start 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 0x7f5b7c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c4840 con 0x7f5b7c160d20 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c4b20 con 0x7f5b7c0cf730 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b80c1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c4e00 con 0x7f5b7c0cb9f0 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b7ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b7ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33080/0 (socket says 172.21.15.161:33080) 2023-08-10T10:29:47.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.444+0000 7f5b7ad9d700 1 -- 172.21.15.161:0/943422161 learned_addr learned my addr 172.21.15.161:0/943422161 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7a59c700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b79d9b700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 0x7f5b7c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 -- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 msgr2=0x7f5b7c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 -- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 msgr2=0x7f5b7c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 0x7f5b7c0adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 -- 172.21.15.161:0/943422161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70009550 con 0x7f5b7c160d20 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b79d9b700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 0x7f5b7c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b7ad9d700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400cc10 tx=0x7f5b7400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400abb0 con 0x7f5b7c160d20 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400ad10 con 0x7f5b7c160d20 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c0c50e0 con 0x7f5b7c160d20 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74012660 con 0x7f5b7c160d20 2023-08-10T10:29:47.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.445+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c15e780 con 0x7f5b7c160d20 2023-08-10T10:29:47.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.446+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c160b10 con 0x7f5b7c160d20 2023-08-10T10:29:47.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.446+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b740127c0 con 0x7f5b7c160d20 2023-08-10T10:29:47.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.447+0000 7f5b6affd700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 0x7f5b5c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.447+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5b74089cf0 con 0x7f5b7c160d20 2023-08-10T10:29:47.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.447+0000 7f5b7a59c700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 0x7f5b5c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.447+0000 7f5b7a59c700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 0x7f5b5c06d1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00a950 tx=0x7f5b6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.451+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5b7c160b10 con 0x7f5b7c160d20 2023-08-10T10:29:47.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.639+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b7c0c5600 con 0x7f5b7c160d20 2023-08-10T10:29:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.639+0000 7f5b6affd700 1 -- 172.21.15.161:0/943422161 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b7c0c5600 con 0x7f5b7c160d20 2023-08-10T10:29:47.640 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 msgr2=0x7f5b5c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 0x7f5b5c06d1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00a950 tx=0x7f5b6c008040 comp rx=0 tx=0).stop 2023-08-10T10:29:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 msgr2=0x7f5b7c0ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400cc10 tx=0x7f5b7400a060 comp rx=0 tx=0).stop 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 shutdown_connections 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5b5c06ad10 0x7f5b5c06d1d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c160d20 0x7f5b7c0ae010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0cb9f0 0x7f5b7c15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 --2- 172.21.15.161:0/943422161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c0cf730 0x7f5b7c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 >> 172.21.15.161:0/943422161 conn(0x7f5b7c0cc740 msgr2=0x7f5b7c0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 shutdown_connections 2023-08-10T10:29:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.641+0000 7f5b80c1e700 1 -- 172.21.15.161:0/943422161 wait complete. 2023-08-10T10:29:47.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.777+0000 7ff236f1d700 1 Processor -- start 2023-08-10T10:29:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.777+0000 7ff236f1d700 1 -- start start 2023-08-10T10:29:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff236f1d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2300cb9f0 0x7ff2300b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff236f1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23006a190 0x7ff23006a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff236f1d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23006ab00 con 0x7ff230160d20 2023-08-10T10:29:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff236f1d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff230071950 con 0x7ff2300cb9f0 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff236f1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b2660 con 0x7ff23006a190 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff234cb9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2300cb9f0 0x7ff2300b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff234cb9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2300cb9f0 0x7ff2300b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33084/0 (socket says 172.21.15.161:33084) 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff234cb9700 1 -- 172.21.15.161:0/2636328774 learned_addr learned my addr 172.21.15.161:0/2636328774 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.778+0000 7ff2354ba700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23006a190 0x7ff23006a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff234cb9700 1 -- 172.21.15.161:0/2636328774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23006a190 msgr2=0x7ff23006a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff234cb9700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23006a190 0x7ff23006a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff234cb9700 1 -- 172.21.15.161:0/2636328774 >> v1:172.21.15.175:6789/0 conn(0x7ff230160d20 legacy=0x7ff2300cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff234cb9700 1 -- 172.21.15.161:0/2636328774 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23006dc10 con 0x7ff2300cb9f0 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff234cb9700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300cb9f0 0x7ff2300b2120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d519a9e5bb785b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff22f7fe700 1 -- 172.21.15.161:0/2636328774 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011830 con 0x7ff2300cb9f0 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff22f7fe700 1 -- 172.21.15.161:0/2636328774 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224011990 con 0x7ff2300cb9f0 2023-08-10T10:29:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.779+0000 7ff22f7fe700 1 -- 172.21.15.161:0/2636328774 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011d20 con 0x7ff2300cb9f0 2023-08-10T10:29:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 -- 172.21.15.161:0/2636328774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300cb9f0 msgr2=0x7ff2300b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300cb9f0 0x7ff2300b2120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2240098f0 tx=0x7ff224009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 -- 172.21.15.161:0/2636328774 shutdown_connections 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23006a190 0x7ff23006a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 --2- 172.21.15.161:0/2636328774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300cb9f0 0x7ff2300b2120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 -- 172.21.15.161:0/2636328774 >> 172.21.15.161:0/2636328774 conn(0x7ff2300cc740 msgr2=0x7ff2300ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 -- 172.21.15.161:0/2636328774 shutdown_connections 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.780+0000 7ff236f1d700 1 -- 172.21.15.161:0/2636328774 wait complete. 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.781+0000 7ff236f1d700 1 Processor -- start 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.781+0000 7ff236f1d700 1 -- start start 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23006a190 0x7ff23015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300cb9f0 0x7ff2300c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015c860 con 0x7ff230160d20 2023-08-10T10:29:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015d710 con 0x7ff23006a190 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015cb00 con 0x7ff2300cb9f0 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33094/0 (socket says 172.21.15.161:33094) 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 -- 172.21.15.161:0/1650677359 learned_addr learned my addr 172.21.15.161:0/1650677359 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff234cb9700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23006a190 0x7ff23015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff22ffff700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300cb9f0 0x7ff2300c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 -- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300cb9f0 msgr2=0x7ff2300c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300cb9f0 0x7ff2300c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 -- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23006a190 msgr2=0x7ff23015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23006a190 0x7ff23015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 -- 172.21.15.161:0/1650677359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009550 con 0x7ff230160d20 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff2354ba700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff22800efc0 tx=0x7ff22800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800cad0 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22800f040 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.782+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23015cde0 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.783+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800ce70 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.783+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23015d3a0 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.783+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23015daa0 con 0x7ff230160d20 2023-08-10T10:29:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.784+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff228014480 con 0x7ff230160d20 2023-08-10T10:29:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.784+0000 7ff22d7fa700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 0x7ff21406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.784+0000 7ff234cb9700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 0x7ff21406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.784+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff228089ef0 con 0x7ff230160d20 2023-08-10T10:29:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.785+0000 7ff234cb9700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 0x7ff21406d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff224009c40 tx=0x7ff224008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:47.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.789+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff23015daa0 con 0x7ff230160d20 2023-08-10T10:29:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.975+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff23015daa0 con 0x7ff230160d20 2023-08-10T10:29:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.975+0000 7ff22d7fa700 1 -- 172.21.15.161:0/1650677359 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff23015daa0 con 0x7ff230160d20 2023-08-10T10:29:47.976 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 msgr2=0x7ff21406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 0x7ff21406d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff224009c40 tx=0x7ff224008030 comp rx=0 tx=0).stop 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 msgr2=0x7ff2300c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff22800efc0 tx=0x7ff22800c0c0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 shutdown_connections 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff21406ace0 0x7ff21406d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff230160d20 0x7ff2300c88c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23006a190 0x7ff23015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 --2- 172.21.15.161:0/1650677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300cb9f0 0x7ff2300c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.977+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 >> 172.21.15.161:0/1650677359 conn(0x7ff2300cc740 msgr2=0x7ff2300ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.978+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 shutdown_connections 2023-08-10T10:29:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:47.978+0000 7ff236f1d700 1 -- 172.21.15.161:0/1650677359 wait complete. 2023-08-10T10:29:47.990 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.112+0000 7f492ff33700 1 Processor -- start 2023-08-10T10:29:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.113+0000 7f492ff33700 1 -- start start 2023-08-10T10:29:48.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.113+0000 7f492ff33700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49280cef20 0x7f49280ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.113+0000 7f492ff33700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928071f60 con 0x7f49280ce6f0 2023-08-10T10:29:48.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.113+0000 7f492ff33700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928072710 con 0x7f492815b380 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.113+0000 7f492ff33700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492806a8a0 con 0x7f49280cef20 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49280cef20 0x7f49280ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49280cef20 0x7f49280ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33100/0 (socket says 172.21.15.161:33100) 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492e4d0700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f49280ce6f0 0x7f492815b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38340/0 (socket says 172.21.15.161:38340) 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 -- 172.21.15.161:0/430253016 learned_addr learned my addr 172.21.15.161:0/430253016 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 -- 172.21.15.161:0/430253016 >> v1:172.21.15.175:6789/0 conn(0x7f492815b380 legacy=0x7f492806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 -- 172.21.15.161:0/430253016 >> v1:172.21.15.161:6789/0 conn(0x7f49280ce6f0 legacy=0x7f492815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 -- 172.21.15.161:0/430253016 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928072190 con 0x7f49280cef20 2023-08-10T10:29:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492cccd700 1 -- 172.21.15.161:0/430253016 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550511635 0 0) 0x7f4928071f60 con 0x7f49280ce6f0 2023-08-10T10:29:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492d4ce700 1 --2- 172.21.15.161:0/430253016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280cef20 0x7f49280ce1b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f49240098f0 tx=0x7f4924009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7f6435191c1ddd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492cccd700 1 -- 172.21.15.161:0/430253016 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400b8a0 con 0x7f49280cef20 2023-08-10T10:29:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492cccd700 1 -- 172.21.15.161:0/430253016 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492400ba00 con 0x7f49280cef20 2023-08-10T10:29:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.114+0000 7f492cccd700 1 -- 172.21.15.161:0/430253016 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400bd90 con 0x7f49280cef20 2023-08-10T10:29:48.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 -- 172.21.15.161:0/430253016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280cef20 msgr2=0x7f49280ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 --2- 172.21.15.161:0/430253016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280cef20 0x7f49280ce1b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f49240098f0 tx=0x7f4924009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:48.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 -- 172.21.15.161:0/430253016 shutdown_connections 2023-08-10T10:29:48.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 --2- 172.21.15.161:0/430253016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280cef20 0x7f49280ce1b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 -- 172.21.15.161:0/430253016 >> 172.21.15.161:0/430253016 conn(0x7f49280cf4c0 msgr2=0x7f49280cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:48.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 -- 172.21.15.161:0/430253016 shutdown_connections 2023-08-10T10:29:48.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.115+0000 7f492ff33700 1 -- 172.21.15.161:0/430253016 wait complete. 2023-08-10T10:29:48.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.116+0000 7f492ff33700 1 Processor -- start 2023-08-10T10:29:48.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.116+0000 7f492ff33700 1 -- start start 2023-08-10T10:29:48.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49280ce6f0 0x7f49281487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49280cef20 0x7f49280c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280ca560 con 0x7f49280ca050 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280ca840 con 0x7f49280cef20 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492ff33700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49280cab20 con 0x7f49280ce6f0 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33108/0 (socket says 172.21.15.161:33108) 2023-08-10T10:29:48.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 -- 172.21.15.161:0/2580395482 learned_addr learned my addr 172.21.15.161:0/2580395482 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492d4ce700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49280cef20 0x7f49280c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492dccf700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49280ce6f0 0x7f49281487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 -- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49280ce6f0 msgr2=0x7f49281487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49280ce6f0 0x7f49281487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 -- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49280cef20 msgr2=0x7f49280c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49280cef20 0x7f49280c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 -- 172.21.15.161:0/2580395482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009550 con 0x7f49280ca050 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f492e4d0700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f492000cb90 tx=0x7f492000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000aaa0 con 0x7f49280ca050 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.117+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000ac20 con 0x7f49280ca050 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.118+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49280cae00 con 0x7f49280ca050 2023-08-10T10:29:48.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.118+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200070d0 con 0x7f49280ca050 2023-08-10T10:29:48.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.118+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49280cb600 con 0x7f49280ca050 2023-08-10T10:29:48.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.118+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49280d03a0 con 0x7f49280ca050 2023-08-10T10:29:48.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.119+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4920007230 con 0x7f49280ca050 2023-08-10T10:29:48.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.119+0000 7f491e7fc700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 0x7f490c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.119+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4920089260 con 0x7f49280ca050 2023-08-10T10:29:48.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.119+0000 7f492dccf700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 0x7f490c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.120+0000 7f492dccf700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 0x7f490c06d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4918007fd0 tx=0x7f4918009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.124+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4920054240 con 0x7f49280ca050 2023-08-10T10:29:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.311+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f492804ecc0 con 0x7f49280ca050 2023-08-10T10:29:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.311+0000 7f491e7fc700 1 -- 172.21.15.161:0/2580395482 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49200180a0 con 0x7f49280ca050 2023-08-10T10:29:48.312 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 msgr2=0x7f490c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 0x7f490c06d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4918007fd0 tx=0x7f4918009040 comp rx=0 tx=0).stop 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 msgr2=0x7f49280ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f492000cb90 tx=0x7f492000cea0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 shutdown_connections 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f490c06ace0 0x7f490c06d1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49280ca050 0x7f49280ac850 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49280ce6f0 0x7f49281487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 --2- 172.21.15.161:0/2580395482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49280cef20 0x7f49280c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 >> 172.21.15.161:0/2580395482 conn(0x7f49280cf4c0 msgr2=0x7f492806a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 shutdown_connections 2023-08-10T10:29:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.313+0000 7f492ff33700 1 -- 172.21.15.161:0/2580395482 wait complete. 2023-08-10T10:29:48.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:29:48.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.447+0000 7f9255a78700 1 Processor -- start 2023-08-10T10:29:48.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.447+0000 7f9255a78700 1 -- start start 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f9255a78700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92500cf960 0x7f92500d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f9255a78700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f925015d540 0x7f92500cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f9255a78700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92500d1680 con 0x7f92500d0280 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f9255a78700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500d1960 con 0x7f92500cf960 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f9255a78700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500d1c40 con 0x7f925015d540 2023-08-10T10:29:48.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f924f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92500cf960 0x7f92500d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f924f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92500cf960 0x7f92500d3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33112/0 (socket says 172.21.15.161:33112) 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f924ffff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f92500d0280 0x7f92500cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38354/0 (socket says 172.21.15.161:38354) 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.448+0000 7f924f7fe700 1 -- 172.21.15.161:0/3763757638 learned_addr learned my addr 172.21.15.161:0/3763757638 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924effd700 1 --2- 172.21.15.161:0/3763757638 >> v2:172.21.15.175:3300/0 conn(0x7f925015d540 0x7f92500cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924f7fe700 1 -- 172.21.15.161:0/3763757638 >> v2:172.21.15.175:3300/0 conn(0x7f925015d540 msgr2=0x7f92500cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924f7fe700 1 --2- 172.21.15.161:0/3763757638 >> v2:172.21.15.175:3300/0 conn(0x7f925015d540 0x7f92500cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924f7fe700 1 -- 172.21.15.161:0/3763757638 >> v1:172.21.15.161:6789/0 conn(0x7f92500d0280 legacy=0x7f92500cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924f7fe700 1 -- 172.21.15.161:0/3763757638 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500d1f20 con 0x7f92500cf960 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924e7fc700 1 -- 172.21.15.161:0/3763757638 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331779335 0 0) 0x7f92500d1680 con 0x7f92500d0280 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924f7fe700 1 --2- 172.21.15.161:0/3763757638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92500cf960 0x7f92500d3b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f92500b4ac0 tx=0x7f9244009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe21a6782ded9f25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924e7fc700 1 -- 172.21.15.161:0/3763757638 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244005e30 con 0x7f92500cf960 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924e7fc700 1 -- 172.21.15.161:0/3763757638 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9244004030 con 0x7f92500cf960 2023-08-10T10:29:48.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f924e7fc700 1 -- 172.21.15.161:0/3763757638 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440043e0 con 0x7f92500cf960 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f9255a78700 1 -- 172.21.15.161:0/3763757638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92500cf960 msgr2=0x7f92500d3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.449+0000 7f9255a78700 1 --2- 172.21.15.161:0/3763757638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92500cf960 0x7f92500d3b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f92500b4ac0 tx=0x7f9244009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 -- 172.21.15.161:0/3763757638 shutdown_connections 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 --2- 172.21.15.161:0/3763757638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92500cf960 0x7f92500d3b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 --2- 172.21.15.161:0/3763757638 >> v2:172.21.15.175:3300/0 conn(0x7f925015d540 0x7f92500cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 -- 172.21.15.161:0/3763757638 >> 172.21.15.161:0/3763757638 conn(0x7f92500d3000 msgr2=0x7f92500d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:48.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 -- 172.21.15.161:0/3763757638 shutdown_connections 2023-08-10T10:29:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.450+0000 7f9255a78700 1 -- 172.21.15.161:0/3763757638 wait complete. 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.451+0000 7f9255a78700 1 Processor -- start 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.451+0000 7f9255a78700 1 -- start start 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92500cf960 0x7f92501f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92500d0280 0x7f92500c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501f5df0 con 0x7f925015d540 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925015e310 con 0x7f92500d0280 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925015e5f0 con 0x7f92500cf960 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33122/0 (socket says 172.21.15.161:33122) 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 -- 172.21.15.161:0/459124686 learned_addr learned my addr 172.21.15.161:0/459124686 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924f7fe700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92500cf960 0x7f92501f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924effd700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92500d0280 0x7f92500c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 -- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92500cf960 msgr2=0x7f92501f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92500cf960 0x7f92501f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 -- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92500d0280 msgr2=0x7f92500c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92500d0280 0x7f92500c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 -- 172.21.15.161:0/459124686 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009500 con 0x7f925015d540 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f924ffff700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9248002230 tx=0x7f924800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800ac20 con 0x7f925015d540 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800ada0 con 0x7f925015d540 2023-08-10T10:29:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925015e8d0 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248007310 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.452+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925015ee90 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.453+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92500725b0 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.454+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9248007470 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.454+0000 7f9237fff700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 0x7f923c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.454+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f92480893e0 con 0x7f925015d540 2023-08-10T10:29:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.454+0000 7f924f7fe700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 0x7f923c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.455+0000 7f924f7fe700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 0x7f923c06d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f92500b4ac0 tx=0x7f9244008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.459+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9248054450 con 0x7f925015d540 2023-08-10T10:29:48.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.667+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f925015f0b0 con 0x7f925015d540 2023-08-10T10:29:48.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.668+0000 7f9237fff700 1 -- 172.21.15.161:0/459124686 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9248057a70 con 0x7f925015d540 2023-08-10T10:29:48.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 msgr2=0x7f923c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 0x7f923c06d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f92500b4ac0 tx=0x7f9244008070 comp rx=0 tx=0).stop 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 msgr2=0x7f92500d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9248002230 tx=0x7f924800a060 comp rx=0 tx=0).stop 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 shutdown_connections 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f923c06ace0 0x7f923c06d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f925015d540 0x7f92500d06d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92500cf960 0x7f92501f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 --2- 172.21.15.161:0/459124686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92500d0280 0x7f92500c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 >> 172.21.15.161:0/459124686 conn(0x7f92500d3000 msgr2=0x7f925006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:48.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 shutdown_connections 2023-08-10T10:29:48.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.670+0000 7f9255a78700 1 -- 172.21.15.161:0/459124686 wait complete. 2023-08-10T10:29:48.672 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-08-10T10:29:48.682 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-10T10:29:48.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:48.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-10T10:29:48.727 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-08-10T10:29:48.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:29:48.728 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-10T10:29:48.748 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:29:48.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.870+0000 7f1640610700 1 Processor -- start 2023-08-10T10:29:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.870+0000 7f1640610700 1 -- start start 2023-08-10T10:29:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f1640610700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16381608b0 0x7f16380cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f1640610700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1638160de0 0x7f16380ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f1640610700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16380ac850 con 0x7f16380ceab0 2023-08-10T10:29:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f1640610700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380cef40 con 0x7f1638160de0 2023-08-10T10:29:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f1640610700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163806a500 con 0x7f16381608b0 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163ebad700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f16380ceab0 0x7f16380cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38368/0 (socket says 172.21.15.161:38368) 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163ebad700 1 -- 172.21.15.161:0/935139408 learned_addr learned my addr 172.21.15.161:0/935139408 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> v2:172.21.15.175:3300/0 conn(0x7f1638160de0 0x7f16380ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163e3ac700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16381608b0 0x7f16380cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46841760 0 0) 0x7f16380ac850 con 0x7f16380ceab0 2023-08-10T10:29:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16240035b0 con 0x7f16380ceab0 2023-08-10T10:29:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283595743 0 0) 0x7f16240035b0 con 0x7f16380ceab0 2023-08-10T10:29:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16381608b0 msgr2=0x7f16380cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16381608b0 0x7f16380cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 >> v2:172.21.15.175:3300/0 conn(0x7f1638160de0 msgr2=0x7f16380ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 --2- 172.21.15.161:0/935139408 >> v2:172.21.15.175:3300/0 conn(0x7f1638160de0 0x7f16380ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638161630 con 0x7f16380ceab0 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f16300019f0 con 0x7f16380ceab0 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> v2:172.21.15.175:3300/0 conn(0x7f1638160de0 0x7f16380ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 >> v1:172.21.15.161:6789/0 conn(0x7f16380ceab0 legacy=0x7f16380cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1624003a00 0x7f1624003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16240043f0 0x7f16240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624004f40 0x7f162400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380cef40 con 0x7f16240043f0 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163806a500 con 0x7f1624004f40 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162400bf50 con 0x7f1624003a00 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.871+0000 7f163e3ac700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16381608b0 0x7f16380cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16240043f0 0x7f16240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163ebad700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624004f40 0x7f162400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163e3ac700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1624003a00 0x7f1624003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 -- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1624003a00 msgr2=0x7f1624003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1624003a00 0x7f1624003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 -- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624004f40 msgr2=0x7f162400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624004f40 0x7f162400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 -- 172.21.15.161:0/935139408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240035b0 con 0x7f16240043f0 2023-08-10T10:29:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163ebad700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624004f40 0x7f162400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163dbab700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16240043f0 0x7f16240048d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1628009d30 tx=0x7f1624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb34790c77441dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628009e80 con 0x7f16240043f0 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162800e9a0 con 0x7f16240043f0 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.872+0000 7f163d3aa700 1 -- 172.21.15.161:0/935139408 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800ed30 con 0x7f16240043f0 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 -- 172.21.15.161:0/935139408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16240043f0 msgr2=0x7f16240048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 --2- 172.21.15.161:0/935139408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16240043f0 0x7f16240048d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1628009d30 tx=0x7f1624005880 comp rx=0 tx=0).stop 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f163ebad700 1 -- 172.21.15.161:0/935139408 reap_dead start 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 -- 172.21.15.161:0/935139408 shutdown_connections 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 -- 172.21.15.161:0/935139408 >> 172.21.15.161:0/935139408 conn(0x7f16380cf450 msgr2=0x7f16380cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 -- 172.21.15.161:0/935139408 shutdown_connections 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.873+0000 7f1640610700 1 -- 172.21.15.161:0/935139408 wait complete. 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.874+0000 7f1640610700 1 Processor -- start 2023-08-10T10:29:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.874+0000 7f1640610700 1 -- start start 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16240043f0 0x7f16380c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16380c4f90 0x7f16380c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c92a0 con 0x7f16380b43d0 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c3990 con 0x7f16240043f0 2023-08-10T10:29:48.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c3be0 con 0x7f16380c4f90 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33140/0 (socket says 172.21.15.161:33140) 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 -- 172.21.15.161:0/312417425 learned_addr learned my addr 172.21.15.161:0/312417425 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163e3ac700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16240043f0 0x7f16380c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163ebad700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16380c4f90 0x7f16380c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 -- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16380c4f90 msgr2=0x7f16380c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16380c4f90 0x7f16380c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 -- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16240043f0 msgr2=0x7f16380c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16240043f0 0x7f16380c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 -- 172.21.15.161:0/312417425 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380c3ec0 con 0x7f16380b43d0 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f163dbab700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1628000c00 tx=0x7f16280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628006e60 con 0x7f16380b43d0 2023-08-10T10:29:48.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628003af0 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16380c41a0 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628003ea0 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.875+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380c5950 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.876+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16380c6750 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.877+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1628013470 con 0x7f16380b43d0 2023-08-10T10:29:48.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.877+0000 7f162effd700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 0x7f161c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:48.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.877+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f162808b090 con 0x7f16380b43d0 2023-08-10T10:29:48.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.877+0000 7f163e3ac700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 0x7f161c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:48.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.878+0000 7f163e3ac700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 0x7f161c06d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1638066e80 tx=0x7f1634008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:48.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:48.881+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1628056360 con 0x7f16380b43d0 2023-08-10T10:29:49.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.109+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16380744e0 con 0x7f16380b43d0 2023-08-10T10:29:49.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.110+0000 7f162effd700 1 -- 172.21.15.161:0/312417425 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f1628059980 con 0x7f16380b43d0 2023-08-10T10:29:49.110 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:49.111 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:49.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 msgr2=0x7f161c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 0x7f161c06d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1638066e80 tx=0x7f1634008040 comp rx=0 tx=0).stop 2023-08-10T10:29:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 msgr2=0x7f16380b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1628000c00 tx=0x7f16280047c0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 shutdown_connections 2023-08-10T10:29:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f161c06ace0 0x7f161c06d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16380c4f90 0x7f16380c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16240043f0 0x7f16380c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 --2- 172.21.15.161:0/312417425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16380b43d0 0x7f16380b4850 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 >> 172.21.15.161:0/312417425 conn(0x7f16380cf450 msgr2=0x7f1638070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 shutdown_connections 2023-08-10T10:29:49.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.112+0000 7f1640610700 1 -- 172.21.15.161:0/312417425 wait complete. 2023-08-10T10:29:49.115 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:49.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:49.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.245+0000 7f862b919700 1 Processor -- start 2023-08-10T10:29:49.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.245+0000 7f862b919700 1 -- start start 2023-08-10T10:29:49.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f862b919700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f862406a190 0x7f86240c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f862b919700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f86240aea70 0x7f862406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f862b919700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240cf6a0 con 0x7f8624071940 2023-08-10T10:29:49.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f862b919700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862406eb80 con 0x7f862406a190 2023-08-10T10:29:49.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f862b919700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862406ac80 con 0x7f86240aea70 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f86296b5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f862406a190 0x7f86240c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f8629eb6700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8624071940 0x7f862406a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38388/0 (socket says 172.21.15.161:38388) 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f86296b5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f862406a190 0x7f86240c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33146/0 (socket says 172.21.15.161:33146) 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f8629eb6700 1 -- 172.21.15.161:0/1411670478 learned_addr learned my addr 172.21.15.161:0/1411670478 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f8628eb4700 1 --2- 172.21.15.161:0/1411670478 >> v2:172.21.15.175:3300/0 conn(0x7f86240aea70 0x7f862406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f86296b5700 1 -- 172.21.15.161:0/1411670478 >> v2:172.21.15.175:3300/0 conn(0x7f86240aea70 msgr2=0x7f862406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f86296b5700 1 --2- 172.21.15.161:0/1411670478 >> v2:172.21.15.175:3300/0 conn(0x7f86240aea70 0x7f862406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.246+0000 7f86296b5700 1 -- 172.21.15.161:0/1411670478 >> v1:172.21.15.161:6789/0 conn(0x7f8624071940 legacy=0x7f862406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f861bfff700 1 -- 172.21.15.161:0/1411670478 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782363291 0 0) 0x7f86240cf6a0 con 0x7f8624071940 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f86296b5700 1 -- 172.21.15.161:0/1411670478 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862406d260 con 0x7f862406a190 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f86296b5700 1 --2- 172.21.15.161:0/1411670478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f862406a190 0x7f86240c6810 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f862406e280 tx=0x7f8614009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0facbeebef1244 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f861bfff700 1 -- 172.21.15.161:0/1411670478 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614011830 con 0x7f862406a190 2023-08-10T10:29:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f861bfff700 1 -- 172.21.15.161:0/1411670478 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614011990 con 0x7f862406a190 2023-08-10T10:29:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f861bfff700 1 -- 172.21.15.161:0/1411670478 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614011d20 con 0x7f862406a190 2023-08-10T10:29:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 -- 172.21.15.161:0/1411670478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f862406a190 msgr2=0x7f86240c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 --2- 172.21.15.161:0/1411670478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f862406a190 0x7f86240c6810 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f862406e280 tx=0x7f8614009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 -- 172.21.15.161:0/1411670478 shutdown_connections 2023-08-10T10:29:49.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 --2- 172.21.15.161:0/1411670478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f862406a190 0x7f86240c6810 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 --2- 172.21.15.161:0/1411670478 >> v2:172.21.15.175:3300/0 conn(0x7f86240aea70 0x7f862406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 -- 172.21.15.161:0/1411670478 >> 172.21.15.161:0/1411670478 conn(0x7f86240cfd70 msgr2=0x7f86240d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 -- 172.21.15.161:0/1411670478 shutdown_connections 2023-08-10T10:29:49.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.247+0000 7f862b919700 1 -- 172.21.15.161:0/1411670478 wait complete. 2023-08-10T10:29:49.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 Processor -- start 2023-08-10T10:29:49.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 -- start start 2023-08-10T10:29:49.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f862406a190 0x7f86241f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8624071940 0x7f862415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240b4170 con 0x7f86240aea70 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86241f5dd0 con 0x7f8624071940 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.249+0000 7f862b919700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86241f6070 con 0x7f862406a190 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33156/0 (socket says 172.21.15.161:33156) 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 -- 172.21.15.161:0/2208314848 learned_addr learned my addr 172.21.15.161:0/2208314848 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:49.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8628eb4700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8624071940 0x7f862415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f86296b5700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f862406a190 0x7f86241f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 -- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f862406a190 msgr2=0x7f86241f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f862406a190 0x7f86241f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 -- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8624071940 msgr2=0x7f862415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8624071940 0x7f862415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 -- 172.21.15.161:0/2208314848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140094a0 con 0x7f86240aea70 2023-08-10T10:29:49.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8629eb6700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f861c002230 tx=0x7f861c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00ac20 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00ada0 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c007310 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86241f6350 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.250+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862415ec90 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.251+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86241f6870 con 0x7f86240aea70 2023-08-10T10:29:49.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.252+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f861c007470 con 0x7f86240aea70 2023-08-10T10:29:49.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.252+0000 7f8619ffb700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 0x7f860806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.252+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f861c088fd0 con 0x7f86240aea70 2023-08-10T10:29:49.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.252+0000 7f86296b5700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 0x7f860806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.252+0000 7f86296b5700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 0x7f860806d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8614009b60 tx=0x7f8614008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.256+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f86241f6870 con 0x7f86240aea70 2023-08-10T10:29:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.444+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86241f6870 con 0x7f86240aea70 2023-08-10T10:29:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.445+0000 7f8619ffb700 1 -- 172.21.15.161:0/2208314848 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f86241f6870 con 0x7f86240aea70 2023-08-10T10:29:49.446 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:49.446 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:45.529227+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.447+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 msgr2=0x7f860806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.447+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 0x7f860806d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8614009b60 tx=0x7f8614008030 comp rx=0 tx=0).stop 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.447+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 msgr2=0x7f862415c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.447+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f861c002230 tx=0x7f861c00a060 comp rx=0 tx=0).stop 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 shutdown_connections 2023-08-10T10:29:49.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f860806ace0 0x7f860806d1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86240aea70 0x7f862415c500 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f862406a190 0x7f86241f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 --2- 172.21.15.161:0/2208314848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8624071940 0x7f862415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 >> 172.21.15.161:0/2208314848 conn(0x7f86240cfd70 msgr2=0x7f8624160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 shutdown_connections 2023-08-10T10:29:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.448+0000 7f862b919700 1 -- 172.21.15.161:0/2208314848 wait complete. 2023-08-10T10:29:49.460 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:29:01.426887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:29:01.841430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:29:49.461 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:29:49.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.586+0000 7f14d5482700 1 Processor -- start 2023-08-10T10:29:49.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.586+0000 7f14d5482700 1 -- start start 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14d5482700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 0x7f14d006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14d5482700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14d0161940 0x7f14d006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14d5482700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d006e730 con 0x7f14d006da70 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14d5482700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00af5b0 con 0x7f14d0161940 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14d5482700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d0160e60 con 0x7f14d00cb790 2023-08-10T10:29:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14d0161940 0x7f14d006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cf7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f14d006da70 0x7f14d006deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38402/0 (socket says 172.21.15.161:38402) 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14d0161940 0x7f14d006a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33160/0 (socket says 172.21.15.161:33160) 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cf7fe700 1 -- 172.21.15.161:0/771414691 learned_addr learned my addr 172.21.15.161:0/771414691 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ceffd700 1 --2- 172.21.15.161:0/771414691 >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 0x7f14d006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 -- 172.21.15.161:0/771414691 >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 msgr2=0x7f14d006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:49.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 --2- 172.21.15.161:0/771414691 >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 0x7f14d006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 -- 172.21.15.161:0/771414691 >> v1:172.21.15.161:6789/0 conn(0x7f14d006da70 legacy=0x7f14d006deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 -- 172.21.15.161:0/771414691 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0161140 con 0x7f14d0161940 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cdffb700 1 -- 172.21.15.161:0/771414691 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228879167 0 0) 0x7f14d006e730 con 0x7f14d006da70 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ceffd700 1 --2- 172.21.15.161:0/771414691 >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 0x7f14d006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14ce7fc700 1 --2- 172.21.15.161:0/771414691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d006a6d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14d00724d0 tx=0x7f14c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1430ba48c80070 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cdffb700 1 -- 172.21.15.161:0/771414691 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011830 con 0x7f14d0161940 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cdffb700 1 -- 172.21.15.161:0/771414691 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0011990 con 0x7f14d0161940 2023-08-10T10:29:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.587+0000 7f14cdffb700 1 -- 172.21.15.161:0/771414691 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011d20 con 0x7f14d0161940 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 -- 172.21.15.161:0/771414691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 msgr2=0x7f14d006a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 --2- 172.21.15.161:0/771414691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d006a6d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14d00724d0 tx=0x7f14c0009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 -- 172.21.15.161:0/771414691 shutdown_connections 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 --2- 172.21.15.161:0/771414691 >> v2:172.21.15.175:3300/0 conn(0x7f14d00cb790 0x7f14d006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 --2- 172.21.15.161:0/771414691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d006a6d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 -- 172.21.15.161:0/771414691 >> 172.21.15.161:0/771414691 conn(0x7f14d00cfc90 msgr2=0x7f14d00d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 -- 172.21.15.161:0/771414691 shutdown_connections 2023-08-10T10:29:49.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.588+0000 7f14d5482700 1 -- 172.21.15.161:0/771414691 wait complete. 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.589+0000 7f14d5482700 1 Processor -- start 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.589+0000 7f14d5482700 1 -- start start 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14d006da70 0x7f14d015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 0x7f14d01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0159b20 con 0x7f14d0161940 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b28b0 con 0x7f14d00cb790 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14d5482700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b2b70 con 0x7f14d006da70 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33170/0 (socket says 172.21.15.161:33170) 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.590+0000 7f14cf7fe700 1 -- 172.21.15.161:0/2970896904 learned_addr learned my addr 172.21.15.161:0/2970896904 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14ce7fc700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 0x7f14d01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14ceffd700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14d006da70 0x7f14d015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 -- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14d006da70 msgr2=0x7f14d015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14d006da70 0x7f14d015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 -- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 msgr2=0x7f14d01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 0x7f14d01595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 -- 172.21.15.161:0/2970896904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c00094a0 con 0x7f14d0161940 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14ce7fc700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 0x7f14d01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14cf7fe700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14c8002230 tx=0x7f14c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800ac20 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800ada0 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d00b2e50 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8007310 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.591+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d00b3410 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.592+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d004ecc0 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.592+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14c8007470 con 0x7f14d0161940 2023-08-10T10:29:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.593+0000 7f14b77fe700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 0x7f14bc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.593+0000 7f14ceffd700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 0x7f14bc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.593+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f14c80893b0 con 0x7f14d0161940 2023-08-10T10:29:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.593+0000 7f14ceffd700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 0x7f14bc06d1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006fd0 tx=0x7f14c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.597+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f14c8054420 con 0x7f14d0161940 2023-08-10T10:29:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.785+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14d00cea70 con 0x7f14d0161940 2023-08-10T10:29:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.786+0000 7f14b77fe700 1 -- 172.21.15.161:0/2970896904 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14c8057a40 con 0x7f14d0161940 2023-08-10T10:29:49.786 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:29:49.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 msgr2=0x7f14bc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 0x7f14bc06d1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006fd0 tx=0x7f14c4008040 comp rx=0 tx=0).stop 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 msgr2=0x7f14d00ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14c8002230 tx=0x7f14c800a060 comp rx=0 tx=0).stop 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 shutdown_connections 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f14bc06ad10 0x7f14bc06d1d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d0161940 0x7f14d00ca2c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14d006da70 0x7f14d015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 --2- 172.21.15.161:0/2970896904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d00cb790 0x7f14d01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 >> 172.21.15.161:0/2970896904 conn(0x7f14d00cfc90 msgr2=0x7f14d006d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 shutdown_connections 2023-08-10T10:29:49.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.788+0000 7f14d5482700 1 -- 172.21.15.161:0/2970896904 wait complete. 2023-08-10T10:29:49.801 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:29:49.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.925+0000 7f040fc71700 1 Processor -- start 2023-08-10T10:29:49.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.925+0000 7f040fc71700 1 -- start start 2023-08-10T10:29:49.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 0x7f040815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f040815a3b0 0x7f04080cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04080b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080b20f0 con 0x7f040815a3b0 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040815abb0 con 0x7f0408159fd0 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040fc71700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040815ae90 con 0x7f04080b1740 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f040815a3b0 0x7f04080cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f040815a3b0 0x7f04080cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33174/0 (socket says 172.21.15.161:33174) 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 -- 172.21.15.161:0/2480051348 learned_addr learned my addr 172.21.15.161:0/2480051348 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:49.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040e20e700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04080b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040da0d700 1 --2- 172.21.15.161:0/2480051348 >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 0x7f040815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 -- 172.21.15.161:0/2480051348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 msgr2=0x7f04080b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04080b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 -- 172.21.15.161:0/2480051348 >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 msgr2=0x7f040815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 --2- 172.21.15.161:0/2480051348 >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 0x7f040815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 -- 172.21.15.161:0/2480051348 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040815b170 con 0x7f040815a3b0 2023-08-10T10:29:49.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040da0d700 1 --2- 172.21.15.161:0/2480051348 >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 0x7f040815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040d20c700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040815a3b0 0x7f04080cdaa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04080cfc20 tx=0x7f03f800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b85d4bab08cf601 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040ca0b700 1 -- 172.21.15.161:0/2480051348 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f800dc70 con 0x7f040815a3b0 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040ca0b700 1 -- 172.21.15.161:0/2480051348 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f800ddd0 con 0x7f040815a3b0 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.926+0000 7f040ca0b700 1 -- 172.21.15.161:0/2480051348 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8010690 con 0x7f040815a3b0 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 -- 172.21.15.161:0/2480051348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040815a3b0 msgr2=0x7f04080cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040815a3b0 0x7f04080cdaa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04080cfc20 tx=0x7f03f800be70 comp rx=0 tx=0).stop 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 -- 172.21.15.161:0/2480051348 shutdown_connections 2023-08-10T10:29:49.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04080b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 --2- 172.21.15.161:0/2480051348 >> v2:172.21.15.175:3300/0 conn(0x7f0408159fd0 0x7f040815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 --2- 172.21.15.161:0/2480051348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040815a3b0 0x7f04080cdaa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 -- 172.21.15.161:0/2480051348 >> 172.21.15.161:0/2480051348 conn(0x7f04080cc740 msgr2=0x7f04080ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:49.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 -- 172.21.15.161:0/2480051348 shutdown_connections 2023-08-10T10:29:49.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.927+0000 7f040fc71700 1 -- 172.21.15.161:0/2480051348 wait complete. 2023-08-10T10:29:49.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.928+0000 7f040fc71700 1 Processor -- start 2023-08-10T10:29:49.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.928+0000 7f040fc71700 1 -- start start 2023-08-10T10:29:49.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04081f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 0x7f04080c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04080c6720 con 0x7f0408159fd0 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04081f2c20 con 0x7f040815a3b0 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040fc71700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04081f2380 con 0x7f04080b1740 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33182/0 (socket says 172.21.15.161:33182) 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 -- 172.21.15.161:0/3433720070 learned_addr learned my addr 172.21.15.161:0/3433720070 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040da0d700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04081f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040e20e700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 0x7f04080c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 -- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 msgr2=0x7f04081f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04081f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 -- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 msgr2=0x7f04080c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 0x7f04080c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:49.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 -- 172.21.15.161:0/3433720070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f800b7f0 con 0x7f0408159fd0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040e20e700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 0x7f04080c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.929+0000 7f040d20c700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f03f800beb0 tx=0x7f03f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.930+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f801f070 con 0x7f0408159fd0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.930+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f80039f0 con 0x7f0408159fd0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.930+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04081f2660 con 0x7f0408159fd0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.930+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8003dc0 con 0x7f0408159fd0 2023-08-10T10:29:49.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.930+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04080b3c60 con 0x7f0408159fd0 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.931+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040804ecc0 con 0x7f0408159fd0 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.931+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03f8019400 con 0x7f0408159fd0 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.931+0000 7f03fe7fc700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 0x7f03ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.932+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03f808c900 con 0x7f0408159fd0 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.932+0000 7f040da0d700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 0x7f03ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:49.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.932+0000 7f040da0d700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 0x7f03ec06d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0404009930 tx=0x7f0404008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:49.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:49.936+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03f8057960 con 0x7f0408159fd0 2023-08-10T10:29:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.122+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f04080b5c40 con 0x7f0408159fd0 2023-08-10T10:29:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.122+0000 7f03fe7fc700 1 -- 172.21.15.161:0/3433720070 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03f805af80 con 0x7f0408159fd0 2023-08-10T10:29:50.123 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:29:50.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 msgr2=0x7f03ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 0x7f03ec06d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0404009930 tx=0x7f0404008040 comp rx=0 tx=0).stop 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 msgr2=0x7f0408158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f03f800beb0 tx=0x7f03f8004750 comp rx=0 tx=0).stop 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 shutdown_connections 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f03ec06ace0 0x7f03ec06d1a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040815a3b0 0x7f04080c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080b1740 0x7f04081f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 --2- 172.21.15.161:0/3433720070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0408159fd0 0x7f0408158150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 >> 172.21.15.161:0/3433720070 conn(0x7f04080cc740 msgr2=0x7f040806da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 shutdown_connections 2023-08-10T10:29:50.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.124+0000 7f040fc71700 1 -- 172.21.15.161:0/3433720070 wait complete. 2023-08-10T10:29:50.137 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:29:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.261+0000 7fb892c4e700 1 Processor -- start 2023-08-10T10:29:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.261+0000 7fb892c4e700 1 -- start start 2023-08-10T10:29:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb892c4e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cee80 0x7fb88c0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb892c4e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb88c0cd900 0x7fb88c06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb892c4e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c0cb7d0 con 0x7fb88c15d380 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb892c4e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c0cbd30 con 0x7fb88c0cd900 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb892c4e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cddb0 con 0x7fb88c0cee80 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8909ea700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb88c15d380 0x7fb88c0ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38426/0 (socket says 172.21.15.161:38426) 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8909ea700 1 -- 172.21.15.161:0/1854903851 learned_addr learned my addr 172.21.15.161:0/1854903851 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8911eb700 1 --2- 172.21.15.161:0/1854903851 >> v2:172.21.15.161:3300/0 conn(0x7fb88c0cd900 0x7fb88c06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb88bfff700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cee80 0x7fb88c0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8911eb700 1 -- 172.21.15.161:0/1854903851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cee80 msgr2=0x7fb88c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8911eb700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cee80 0x7fb88c0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8911eb700 1 -- 172.21.15.161:0/1854903851 >> v1:172.21.15.161:6789/0 conn(0x7fb88c15d380 legacy=0x7fb88c0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb88b7fe700 1 -- 172.21.15.161:0/1854903851 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540988609 0 0) 0x7fb88c0cb7d0 con 0x7fb88c15d380 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.262+0000 7fb8911eb700 1 -- 172.21.15.161:0/1854903851 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0acb40 con 0x7fb88c0cd900 2023-08-10T10:29:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb8911eb700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cd900 0x7fb88c06ad10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb884009d90 tx=0x7fb88400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea045a93dfbfbb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb88b7fe700 1 -- 172.21.15.161:0/1854903851 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400e070 con 0x7fb88c0cd900 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb88b7fe700 1 -- 172.21.15.161:0/1854903851 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88400bbd0 con 0x7fb88c0cd900 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb88b7fe700 1 -- 172.21.15.161:0/1854903851 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884012430 con 0x7fb88c0cd900 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 -- 172.21.15.161:0/1854903851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cd900 msgr2=0x7fb88c06ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cd900 0x7fb88c06ad10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb884009d90 tx=0x7fb88400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 -- 172.21.15.161:0/1854903851 shutdown_connections 2023-08-10T10:29:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cd900 0x7fb88c06ad10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 --2- 172.21.15.161:0/1854903851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cee80 0x7fb88c0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 -- 172.21.15.161:0/1854903851 >> 172.21.15.161:0/1854903851 conn(0x7fb88c0cf4c0 msgr2=0x7fb88c0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 -- 172.21.15.161:0/1854903851 shutdown_connections 2023-08-10T10:29:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.263+0000 7fb892c4e700 1 -- 172.21.15.161:0/1854903851 wait complete. 2023-08-10T10:29:50.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 Processor -- start 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 -- start start 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 0x7fb88c0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 0x7fb88c1e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c1e3c70 con 0x7fb88c0cee80 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0c9c60 con 0x7fb88c15d380 2023-08-10T10:29:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.265+0000 7fb892c4e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0c7cc0 con 0x7fb88c0cd900 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33196/0 (socket says 172.21.15.161:33196) 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 -- 172.21.15.161:0/3096737935 learned_addr learned my addr 172.21.15.161:0/3096737935 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8911eb700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 0x7fb88c1e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8909ea700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 0x7fb88c0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 -- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 msgr2=0x7fb88c0c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 0x7fb88c0c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 -- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 msgr2=0x7fb88c1e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 0x7fb88c1e4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 -- 172.21.15.161:0/3096737935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884009a70 con 0x7fb88c0cee80 2023-08-10T10:29:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8911eb700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 0x7fb88c1e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8909ea700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 0x7fb88c0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb88bfff700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e810 tx=0x7fb87800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878013610 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878013770 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878013b20 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c15d0b0 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.266+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c0c7600 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.267+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c0c7e00 con 0x7fb88c0cee80 2023-08-10T10:29:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.268+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb878013c80 con 0x7fb88c0cee80 2023-08-10T10:29:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.268+0000 7fb8897fa700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.268+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb878089140 con 0x7fb88c0cee80 2023-08-10T10:29:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.268+0000 7fb8909ea700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.269+0000 7fb8909ea700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 0x7fb87006d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb880000f60 tx=0x7fb880009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.272+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb88c0c7e00 con 0x7fb88c0cee80 2023-08-10T10:29:50.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.457+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb88c0c7e00 con 0x7fb88c0cee80 2023-08-10T10:29:50.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.458+0000 7fb8897fa700 1 -- 172.21.15.161:0/3096737935 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb88c0c7e00 con 0x7fb88c0cee80 2023-08-10T10:29:50.458 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-08-10T10:29:50.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 msgr2=0x7fb87006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 0x7fb87006d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb880000f60 tx=0x7fb880009040 comp rx=0 tx=0).stop 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 msgr2=0x7fb88c0c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e810 tx=0x7fb87800ebd0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 shutdown_connections 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb88c15d380 0x7fb88c1e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0cd900 0x7fb88c0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 --2- 172.21.15.161:0/3096737935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb88c0cee80 0x7fb88c0c9720 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 >> 172.21.15.161:0/3096737935 conn(0x7fb88c0cf4c0 msgr2=0x7fb88c0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 shutdown_connections 2023-08-10T10:29:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.460+0000 7fb892c4e700 1 -- 172.21.15.161:0/3096737935 wait complete. 2023-08-10T10:29:50.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:29:50.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.599+0000 7f1ed3dec700 1 Processor -- start 2023-08-10T10:29:50.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.599+0000 7f1ed3dec700 1 -- start start 2023-08-10T10:29:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed3dec700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 0x7f1ecc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed3dec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 0x7f1ecc06a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed3dec700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc06ab00 con 0x7f1ecc160d20 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed3dec700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc071950 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed3dec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0b2660 con 0x7f1ecc06a190 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed1387700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1ecc160d20 0x7f1ecc0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38440/0 (socket says 172.21.15.161:38440) 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed1387700 1 -- 172.21.15.161:0/945000066 learned_addr learned my addr 172.21.15.161:0/945000066 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed2389700 1 --2- 172.21.15.161:0/945000066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 0x7f1ecc06a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed1b88700 1 --2- 172.21.15.161:0/945000066 >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 0x7f1ecc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed0b86700 1 -- 172.21.15.161:0/945000066 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648505498 0 0) 0x7f1ecc06ab00 con 0x7f1ecc160d20 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed0b86700 1 -- 172.21.15.161:0/945000066 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb80035b0 con 0x7f1ecc160d20 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed2389700 1 -- 172.21.15.161:0/945000066 >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 msgr2=0x7f1ecc0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed2389700 1 --2- 172.21.15.161:0/945000066 >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 0x7f1ecc0b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed2389700 1 -- 172.21.15.161:0/945000066 >> v1:172.21.15.161:6789/0 conn(0x7f1ecc160d20 legacy=0x7f1ecc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed2389700 1 -- 172.21.15.161:0/945000066 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc06dc10 con 0x7f1ecc06a190 2023-08-10T10:29:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.600+0000 7f1ed1b88700 1 --2- 172.21.15.161:0/945000066 >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 0x7f1ecc0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed2389700 1 --2- 172.21.15.161:0/945000066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 0x7f1ecc06a5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcf91c2e19aaf63 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed0b86700 1 -- 172.21.15.161:0/945000066 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400e070 con 0x7f1ecc06a190 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed0b86700 1 -- 172.21.15.161:0/945000066 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec400bb20 con 0x7f1ecc06a190 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed0b86700 1 -- 172.21.15.161:0/945000066 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4012430 con 0x7f1ecc06a190 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 -- 172.21.15.161:0/945000066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 msgr2=0x7f1ecc06a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/945000066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 0x7f1ecc06a5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 -- 172.21.15.161:0/945000066 shutdown_connections 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/945000066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc06a190 0x7f1ecc06a5c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/945000066 >> v2:172.21.15.175:3300/0 conn(0x7f1ecc0cb9f0 0x7f1ecc0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 -- 172.21.15.161:0/945000066 >> 172.21.15.161:0/945000066 conn(0x7f1ecc0cc740 msgr2=0x7f1ecc0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 -- 172.21.15.161:0/945000066 shutdown_connections 2023-08-10T10:29:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.601+0000 7f1ed3dec700 1 -- 172.21.15.161:0/945000066 wait complete. 2023-08-10T10:29:50.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 Processor -- start 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 -- start start 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc06a190 0x7f1ecc159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc160d20 0x7f1ecc0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f6c10 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f5f90 con 0x7f1ecc06a190 2023-08-10T10:29:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed3dec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f6270 con 0x7f1ecc160d20 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.603+0000 7f1ed1387700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33208/0 (socket says 172.21.15.161:33208) 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 -- 172.21.15.161:0/1215971929 learned_addr learned my addr 172.21.15.161:0/1215971929 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1b88700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc06a190 0x7f1ecc159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed2389700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc160d20 0x7f1ecc0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 -- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc160d20 msgr2=0x7f1ecc0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc160d20 0x7f1ecc0ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 -- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc06a190 msgr2=0x7f1ecc159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc06a190 0x7f1ecc159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 -- 172.21.15.161:0/1215971929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80094a0 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed1387700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c700 tx=0x7f1ebc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc005d70 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc0070d0 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec4009a70 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc007460 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.604+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc1f6830 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.605+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc160b10 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.605+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ebc0075c0 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.606+0000 7f1ec27fc700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 0x7f1eb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.606+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ebc088ad0 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.606+0000 7f1ed1b88700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 0x7f1eb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.606+0000 7f1ed1b88700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 0x7f1eb006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d00 tx=0x7f1ec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.610+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ecc160b10 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.797+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ecc160b10 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.798+0000 7f1ec27fc700 1 -- 172.21.15.161:0/1215971929 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ecc160b10 con 0x7f1ecc0cb9f0 2023-08-10T10:29:50.799 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-08-10T10:29:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 msgr2=0x7f1eb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 0x7f1eb006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d00 tx=0x7f1ec8008040 comp rx=0 tx=0).stop 2023-08-10T10:29:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 msgr2=0x7f1ecc0c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c700 tx=0x7f1ebc00cac0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 shutdown_connections 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f1eb006ace0 0x7f1eb006d1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ecc160d20 0x7f1ecc0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc06a190 0x7f1ecc159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 --2- 172.21.15.161:0/1215971929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ecc0cb9f0 0x7f1ecc0c5610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 >> 172.21.15.161:0/1215971929 conn(0x7f1ecc0cc740 msgr2=0x7f1ecc0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 shutdown_connections 2023-08-10T10:29:50.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.800+0000 7f1ed3dec700 1 -- 172.21.15.161:0/1215971929 wait complete. 2023-08-10T10:29:50.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:50.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.933+0000 7f6c7bf53700 1 Processor -- start 2023-08-10T10:29:50.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.933+0000 7f6c7bf53700 1 -- start start 2023-08-10T10:29:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c7bf53700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c740aea70 0x7f6c740c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c7bf53700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740cf6a0 con 0x7f6c7406a190 2023-08-10T10:29:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c7bf53700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7406ae60 con 0x7f6c74071940 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c7bf53700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7406eb80 con 0x7f6c740aea70 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c79cef700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6c7406a190 0x7f6c7406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38452/0 (socket says 172.21.15.161:38452) 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c79cef700 1 -- 172.21.15.161:0/2788155017 learned_addr learned my addr 172.21.15.161:0/2788155017 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c794ee700 1 --2- 172.21.15.161:0/2788155017 >> v2:172.21.15.175:3300/0 conn(0x7f6c740aea70 0x7f6c740c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742420365 0 0) 0x7f6c740cf6a0 con 0x7f6c7406a190 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c600035b0 con 0x7f6c7406a190 2023-08-10T10:29:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437674314 0 0) 0x7f6c600035b0 con 0x7f6c7406a190 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 >> v2:172.21.15.175:3300/0 conn(0x7f6c740aea70 msgr2=0x7f6c740c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 --2- 172.21.15.161:0/2788155017 >> v2:172.21.15.175:3300/0 conn(0x7f6c740aea70 0x7f6c740c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 >> v1:172.21.15.175:6789/0 conn(0x7f6c74071940 legacy=0x7f6c7406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7406e7a0 con 0x7f6c7406a190 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.934+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f6c70001670 con 0x7f6c7406a190 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 >> v1:172.21.15.161:6789/0 conn(0x7f6c7406a190 legacy=0x7f6c7406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c60003a00 0x7f6c60003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c60004850 0x7f6c60004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7406eb80 con 0x7f6c60005210 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000c0b0 con 0x7f6c60003a00 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000c270 con 0x7f6c60004850 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c79cef700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c60003a00 0x7f6c60003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c794ee700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c60004850 0x7f6c60004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 -- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c60004850 msgr2=0x7f6c60004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c60004850 0x7f6c60004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 -- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c60003a00 msgr2=0x7f6c60003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c60003a00 0x7f6c60003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 -- 172.21.15.161:0/2788155017 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600035b0 con 0x7f6c60005210 2023-08-10T10:29:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 -- 172.21.15.161:0/2788155017 reap_dead start 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c7a4f0700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c6000ba10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c240 tx=0x7f6c60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91136034da03289 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c001df0 con 0x7f6c60005210 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00cdc0 con 0x7f6c60005210 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.935+0000 7f6c78ced700 1 -- 172.21.15.161:0/2788155017 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003c40 con 0x7f6c60005210 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 -- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 msgr2=0x7f6c6000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c6000ba10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c240 tx=0x7f6c60005880 comp rx=0 tx=0).stop 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 -- 172.21.15.161:0/2788155017 shutdown_connections 2023-08-10T10:29:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/2788155017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c6000ba10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 -- 172.21.15.161:0/2788155017 >> 172.21.15.161:0/2788155017 conn(0x7f6c740cfd70 msgr2=0x7f6c740d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 -- 172.21.15.161:0/2788155017 shutdown_connections 2023-08-10T10:29:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.936+0000 7f6c7bf53700 1 -- 172.21.15.161:0/2788155017 wait complete. 2023-08-10T10:29:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.937+0000 7f6c7bf53700 1 Processor -- start 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.937+0000 7f6c7bf53700 1 -- start start 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c74159e50 0x7f6c7415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c74150d60 0x7f6c741511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7406ac80 con 0x7f6c60005210 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740ac840 con 0x7f6c74159e50 2023-08-10T10:29:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7bf53700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7415a810 con 0x7f6c74150d60 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33226/0 (socket says 172.21.15.161:33226) 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 -- 172.21.15.161:0/3716309204 learned_addr learned my addr 172.21.15.161:0/3716309204 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c794ee700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c74159e50 0x7f6c7415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c7a4f0700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c74150d60 0x7f6c741511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 -- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c74150d60 msgr2=0x7f6c741511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c74150d60 0x7f6c741511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 -- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c74159e50 msgr2=0x7f6c7415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c74159e50 0x7f6c7415a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 -- 172.21.15.161:0/3716309204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74151720 con 0x7f6c60005210 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c79cef700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c700072c0 tx=0x7f6c700075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.938+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000f6c0 con 0x7f6c60005210 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.939+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7000f840 con 0x7f6c60005210 2023-08-10T10:29:50.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.939+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000fbf0 con 0x7f6c60005210 2023-08-10T10:29:50.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.939+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c740aca50 con 0x7f6c60005210 2023-08-10T10:29:50.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.939+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c740ad010 con 0x7f6c60005210 2023-08-10T10:29:50.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.939+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7415d520 con 0x7f6c60005210 2023-08-10T10:29:50.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.940+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c7000fd50 con 0x7f6c60005210 2023-08-10T10:29:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.940+0000 7f6c6a7fc700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 0x7f6c5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.940+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c700892e0 con 0x7f6c60005210 2023-08-10T10:29:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.940+0000 7f6c794ee700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 0x7f6c5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.941+0000 7f6c794ee700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 0x7f6c5806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406e1f0 tx=0x7f6c64009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:50.944+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6c700543e0 con 0x7f6c60005210 2023-08-10T10:29:51.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.174+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c740744e0 con 0x7f6c60005210 2023-08-10T10:29:51.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.174+0000 7f6c6a7fc700 1 -- 172.21.15.161:0/3716309204 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f6c70057a00 con 0x7f6c60005210 2023-08-10T10:29:51.175 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:51.175 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:51.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 msgr2=0x7f6c5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 0x7f6c5806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406e1f0 tx=0x7f6c64009210 comp rx=0 tx=0).stop 2023-08-10T10:29:51.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 msgr2=0x7f6c7414ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c700072c0 tx=0x7f6c700075d0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 shutdown_connections 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6c5806ace0 0x7f6c5806d1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c74150d60 0x7f6c741511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c60005210 0x7f6c7414ec80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 --2- 172.21.15.161:0/3716309204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c74159e50 0x7f6c7415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 >> 172.21.15.161:0/3716309204 conn(0x7f6c740cfd70 msgr2=0x7f6c740d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 shutdown_connections 2023-08-10T10:29:51.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.177+0000 7f6c7bf53700 1 -- 172.21.15.161:0/3716309204 wait complete. 2023-08-10T10:29:51.179 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:51.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:51.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.309+0000 7f55593fb700 1 Processor -- start 2023-08-10T10:29:51.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.309+0000 7f55593fb700 1 -- start start 2023-08-10T10:29:51.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.310+0000 7f55593fb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55540b0950 0x7f55540b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.310+0000 7f55593fb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540aef60 con 0x7f55540b00f0 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f55593fb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540af240 con 0x7f55540afc40 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f55593fb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55540afae0 con 0x7f55540b0950 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5552ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55540b0950 0x7f55540b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f55537fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f55540b00f0 0x7f55540b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38476/0 (socket says 172.21.15.161:38476) 2023-08-10T10:29:51.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f55537fe700 1 -- 172.21.15.161:0/337271523 learned_addr learned my addr 172.21.15.161:0/337271523 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5552ffd700 1 -- 172.21.15.161:0/337271523 >> v1:172.21.15.175:6789/0 conn(0x7f55540afc40 legacy=0x7f555415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5552ffd700 1 -- 172.21.15.161:0/337271523 >> v1:172.21.15.161:6789/0 conn(0x7f55540b00f0 legacy=0x7f55540b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5552ffd700 1 -- 172.21.15.161:0/337271523 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540af520 con 0x7f55540b0950 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5551ffb700 1 -- 172.21.15.161:0/337271523 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561573874 0 0) 0x7f55540aef60 con 0x7f55540b00f0 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5552ffd700 1 --2- 172.21.15.161:0/337271523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b0950 0x7f55540b0d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5548009820 tx=0x7f5548009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5d1f43afee5792 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5551ffb700 1 -- 172.21.15.161:0/337271523 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548005e30 con 0x7f55540b0950 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5551ffb700 1 -- 172.21.15.161:0/337271523 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548004030 con 0x7f55540b0950 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.311+0000 7f5551ffb700 1 -- 172.21.15.161:0/337271523 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480043c0 con 0x7f55540b0950 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 -- 172.21.15.161:0/337271523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b0950 msgr2=0x7f55540b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 --2- 172.21.15.161:0/337271523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b0950 0x7f55540b0d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5548009820 tx=0x7f5548009b30 comp rx=0 tx=0).stop 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 -- 172.21.15.161:0/337271523 shutdown_connections 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 --2- 172.21.15.161:0/337271523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b0950 0x7f55540b0d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 -- 172.21.15.161:0/337271523 >> 172.21.15.161:0/337271523 conn(0x7f555409a150 msgr2=0x7f55540d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:51.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 -- 172.21.15.161:0/337271523 shutdown_connections 2023-08-10T10:29:51.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.312+0000 7f55593fb700 1 -- 172.21.15.161:0/337271523 wait complete. 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.313+0000 7f55593fb700 1 Processor -- start 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.313+0000 7f55593fb700 1 -- start start 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55540afc40 0x7f5554153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55540b0950 0x7f5554154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5554154490 con 0x7f55540b00f0 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540b6910 con 0x7f55540b0950 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55593fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540b6bf0 con 0x7f55540afc40 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33242/0 (socket says 172.21.15.161:33242) 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 -- 172.21.15.161:0/531655405 learned_addr learned my addr 172.21.15.161:0/531655405 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f5552ffd700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55540afc40 0x7f5554153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55537fe700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55540b0950 0x7f5554154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 -- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55540afc40 msgr2=0x7f5554153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55540afc40 0x7f5554153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 -- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55540b0950 msgr2=0x7f5554154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55540b0950 0x7f5554154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 -- 172.21.15.161:0/531655405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009430 con 0x7f55540b00f0 2023-08-10T10:29:51.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.314+0000 7f55527fc700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f554400b4a0 tx=0x7f554400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.315+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544011830 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.315+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544011990 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.315+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55541546e0 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.315+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544011d40 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.315+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5554154210 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.316+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5554154c00 con 0x7f55540b00f0 2023-08-10T10:29:51.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.316+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5544004020 con 0x7f55540b00f0 2023-08-10T10:29:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.317+0000 7f553b7fe700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 0x7f554006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.317+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5544089390 con 0x7f55540b00f0 2023-08-10T10:29:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.317+0000 7f5552ffd700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 0x7f554006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.317+0000 7f5552ffd700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 0x7f554006d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5548000c00 tx=0x7f5548008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.321+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5544054570 con 0x7f55540b00f0 2023-08-10T10:29:51.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.517+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5554154c00 con 0x7f55540b00f0 2023-08-10T10:29:51.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.518+0000 7f553b7fe700 1 -- 172.21.15.161:0/531655405 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f5554154c00 con 0x7f55540b00f0 2023-08-10T10:29:51.519 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:51.519 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:45.529227+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 msgr2=0x7f554006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 0x7f554006d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5548000c00 tx=0x7f5548008070 comp rx=0 tx=0).stop 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 msgr2=0x7f55540c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f554400b4a0 tx=0x7f554400b7b0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 shutdown_connections 2023-08-10T10:29:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f554006ace0 0x7f554006d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55540b0950 0x7f5554154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55540afc40 0x7f5554153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 --2- 172.21.15.161:0/531655405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55540b00f0 0x7f55540c8850 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 >> 172.21.15.161:0/531655405 conn(0x7f555409a150 msgr2=0x7f555406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 shutdown_connections 2023-08-10T10:29:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.520+0000 7f55593fb700 1 -- 172.21.15.161:0/531655405 wait complete. 2023-08-10T10:29:51.533 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:29:51.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:51.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.655+0000 7fb4eab56700 1 Processor -- start 2023-08-10T10:29:51.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.655+0000 7fb4eab56700 1 -- start start 2023-08-10T10:29:51.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4eab56700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4e415b050 0x7fb4e40d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4eab56700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4e40d1a40 0x7fb4e40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4eab56700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40ce130 con 0x7fb4e40cdd20 2023-08-10T10:29:51.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4eab56700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40ccd40 con 0x7fb4e40d1a40 2023-08-10T10:29:51.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4eab56700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40cc780 con 0x7fb4e415b050 2023-08-10T10:29:51.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4e40d1a40 0x7fb4e40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e90f3700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb4e40cdd20 0x7fb4e40ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38488/0 (socket says 172.21.15.161:38488) 2023-08-10T10:29:51.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e90f3700 1 -- 172.21.15.161:0/1078642810 learned_addr learned my addr 172.21.15.161:0/1078642810 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:51.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e88f2700 1 --2- 172.21.15.161:0/1078642810 >> v2:172.21.15.175:3300/0 conn(0x7fb4e415b050 0x7fb4e40d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e3fff700 1 -- 172.21.15.161:0/1078642810 >> v2:172.21.15.175:3300/0 conn(0x7fb4e415b050 msgr2=0x7fb4e40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e3fff700 1 --2- 172.21.15.161:0/1078642810 >> v2:172.21.15.175:3300/0 conn(0x7fb4e415b050 0x7fb4e40d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e3fff700 1 -- 172.21.15.161:0/1078642810 >> v1:172.21.15.161:6789/0 conn(0x7fb4e40cdd20 legacy=0x7fb4e40ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e3fff700 1 -- 172.21.15.161:0/1078642810 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40cca60 con 0x7fb4e40d1a40 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.656+0000 7fb4e37fe700 1 -- 172.21.15.161:0/1078642810 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234509116 0 0) 0x7fb4e40ce130 con 0x7fb4e40cdd20 2023-08-10T10:29:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4e3fff700 1 --2- 172.21.15.161:0/1078642810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e40d1a40 0x7fb4e40cd7e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4e409a880 tx=0x7fb4d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5435bd91da2fd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4e37fe700 1 -- 172.21.15.161:0/1078642810 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0011830 con 0x7fb4e40d1a40 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4e37fe700 1 -- 172.21.15.161:0/1078642810 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0011990 con 0x7fb4e40d1a40 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4e37fe700 1 -- 172.21.15.161:0/1078642810 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0011d20 con 0x7fb4e40d1a40 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 -- 172.21.15.161:0/1078642810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e40d1a40 msgr2=0x7fb4e40cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 --2- 172.21.15.161:0/1078642810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e40d1a40 0x7fb4e40cd7e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4e409a880 tx=0x7fb4d0009b20 comp rx=0 tx=0).stop 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 -- 172.21.15.161:0/1078642810 shutdown_connections 2023-08-10T10:29:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 --2- 172.21.15.161:0/1078642810 >> v2:172.21.15.175:3300/0 conn(0x7fb4e415b050 0x7fb4e40d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 --2- 172.21.15.161:0/1078642810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e40d1a40 0x7fb4e40cd7e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 -- 172.21.15.161:0/1078642810 >> 172.21.15.161:0/1078642810 conn(0x7fb4e409a150 msgr2=0x7fb4e40d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 -- 172.21.15.161:0/1078642810 shutdown_connections 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.657+0000 7fb4eab56700 1 -- 172.21.15.161:0/1078642810 wait complete. 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.658+0000 7fb4eab56700 1 Processor -- start 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 -- start start 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e40cdd20 0x7fb4e4150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e40d1a40 0x7fb4e406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41e3f80 con 0x7fb4e415b050 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41e4260 con 0x7fb4e40d1a40 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4eab56700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41e4540 con 0x7fb4e40cdd20 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4e90f3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.659+0000 7fb4e90f3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33256/0 (socket says 172.21.15.161:33256) 2023-08-10T10:29:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 -- 172.21.15.161:0/2588532556 learned_addr learned my addr 172.21.15.161:0/2588532556 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e3fff700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e40d1a40 0x7fb4e406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e88f2700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e40cdd20 0x7fb4e4150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 -- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e40cdd20 msgr2=0x7fb4e4150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e40cdd20 0x7fb4e4150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 -- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e40d1a40 msgr2=0x7fb4e406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e40d1a40 0x7fb4e406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 -- 172.21.15.161:0/2588532556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00094a0 con 0x7fb4e415b050 2023-08-10T10:29:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e90f3700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc002230 tx=0x7fb4dc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00aac0 con 0x7fb4e415b050 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00ac40 con 0x7fb4e415b050 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0070d0 con 0x7fb4e415b050 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e41e4820 con 0x7fb4e415b050 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.660+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e406cb70 con 0x7fb4e415b050 2023-08-10T10:29:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.661+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e41e4d40 con 0x7fb4e415b050 2023-08-10T10:29:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.662+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4dc007250 con 0x7fb4e415b050 2023-08-10T10:29:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.662+0000 7fb4e17fa700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 0x7fb4c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.662+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb4dc088e90 con 0x7fb4e415b050 2023-08-10T10:29:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.662+0000 7fb4e88f2700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 0x7fb4c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.662+0000 7fb4e88f2700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 0x7fb4c806d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8006fd0 tx=0x7fb4d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.666+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4e41e4d40 con 0x7fb4e415b050 2023-08-10T10:29:51.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.895+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4e41e4d40 con 0x7fb4e415b050 2023-08-10T10:29:51.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.896+0000 7fb4e17fa700 1 -- 172.21.15.161:0/2588532556 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7fb4e41e4d40 con 0x7fb4e415b050 2023-08-10T10:29:51.896 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:51.897 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:51.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 msgr2=0x7fb4c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 0x7fb4c806d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8006fd0 tx=0x7fb4d8008040 comp rx=0 tx=0).stop 2023-08-10T10:29:51.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 msgr2=0x7fb4e406b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:51.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc002230 tx=0x7fb4dc00cf50 comp rx=0 tx=0).stop 2023-08-10T10:29:51.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 shutdown_connections 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fb4c806ace0 0x7fb4c806d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e415b050 0x7fb4e406b7e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e40cdd20 0x7fb4e4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 --2- 172.21.15.161:0/2588532556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e40d1a40 0x7fb4e406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 >> 172.21.15.161:0/2588532556 conn(0x7fb4e409a150 msgr2=0x7fb4e40c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 shutdown_connections 2023-08-10T10:29:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:51.898+0000 7fb4eab56700 1 -- 172.21.15.161:0/2588532556 wait complete. 2023-08-10T10:29:51.900 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:51.910 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:29:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.030+0000 7f098f795700 1 Processor -- start 2023-08-10T10:29:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.030+0000 7f098f795700 1 -- start start 2023-08-10T10:29:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f098815b050 0x7f09880d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09880d1a40 0x7f09880cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 0x7f09880ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880ccd40 con 0x7f09880d1a40 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880ce170 con 0x7f09880cdd20 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098f795700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880cc780 con 0x7f098815b050 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09880d1a40 0x7f09880cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09880d1a40 0x7f09880cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33262/0 (socket says 172.21.15.161:33262) 2023-08-10T10:29:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 -- 172.21.15.161:0/1687346846 learned_addr learned my addr 172.21.15.161:0/1687346846 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098dd32700 1 --2- 172.21.15.161:0/1687346846 >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 0x7f09880ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098d531700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f098815b050 0x7f09880d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 -- 172.21.15.161:0/1687346846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f098815b050 msgr2=0x7f09880d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f098815b050 0x7f09880d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 -- 172.21.15.161:0/1687346846 >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 msgr2=0x7f09880ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 --2- 172.21.15.161:0/1687346846 >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 0x7f09880ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 -- 172.21.15.161:0/1687346846 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880cca60 con 0x7f09880d1a40 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098dd32700 1 --2- 172.21.15.161:0/1687346846 >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 0x7f09880ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.031+0000 7f098cd30700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09880d1a40 0x7f09880cd7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0988071d50 tx=0x7f0978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82645c750c912d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f097ffff700 1 -- 172.21.15.161:0/1687346846 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800b870 con 0x7f09880d1a40 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f097ffff700 1 -- 172.21.15.161:0/1687346846 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800b9d0 con 0x7f09880d1a40 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f097ffff700 1 -- 172.21.15.161:0/1687346846 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800bd60 con 0x7f09880d1a40 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 -- 172.21.15.161:0/1687346846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09880d1a40 msgr2=0x7f09880cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09880d1a40 0x7f09880cd7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0988071d50 tx=0x7f0978009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 -- 172.21.15.161:0/1687346846 shutdown_connections 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 --2- 172.21.15.161:0/1687346846 >> v2:172.21.15.175:3300/0 conn(0x7f09880cdd20 0x7f09880ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f098815b050 0x7f09880d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 --2- 172.21.15.161:0/1687346846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09880d1a40 0x7f09880cd7e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 -- 172.21.15.161:0/1687346846 >> 172.21.15.161:0/1687346846 conn(0x7f098809a150 msgr2=0x7f09880d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 -- 172.21.15.161:0/1687346846 shutdown_connections 2023-08-10T10:29:52.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.032+0000 7f098f795700 1 -- 172.21.15.161:0/1687346846 wait complete. 2023-08-10T10:29:52.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.033+0000 7f098f795700 1 Processor -- start 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.033+0000 7f098f795700 1 -- start start 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09880cdd20 0x7f09881f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09880d1a40 0x7f098815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09881f19d0 con 0x7f098815b050 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b4b00 con 0x7f09880cdd20 2023-08-10T10:29:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098f795700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b4de0 con 0x7f09880d1a40 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098dd32700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098dd32700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33270/0 (socket says 172.21.15.161:33270) 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098dd32700 1 -- 172.21.15.161:0/3587478579 learned_addr learned my addr 172.21.15.161:0/3587478579 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098d531700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09880cdd20 0x7f09881f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.034+0000 7f098cd30700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09880d1a40 0x7f098815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 -- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09880d1a40 msgr2=0x7f098815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09880d1a40 0x7f098815c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 -- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09880cdd20 msgr2=0x7f09881f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09880cdd20 0x7f09881f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 -- 172.21.15.161:0/3587478579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978009550 con 0x7f098815b050 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098dd32700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f098000cd10 tx=0x7f098000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000f480 con 0x7f098815b050 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000f600 con 0x7f098815b050 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880b50c0 con 0x7f098815b050 2023-08-10T10:29:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000f9b0 con 0x7f098815b050 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.035+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098815c830 con 0x7f098815b050 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.036+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880744e0 con 0x7f098815b050 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.036+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f098000b040 con 0x7f098815b050 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.037+0000 7f097dffb700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 0x7f096c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.037+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0980089bb0 con 0x7f098815b050 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.037+0000 7f098d531700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 0x7f096c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.037+0000 7f098d531700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 0x7f096c06d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0984006fd0 tx=0x7f0984008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.041+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0980054cb0 con 0x7f098815b050 2023-08-10T10:29:52.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.270+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09880d0510 con 0x7f098815b050 2023-08-10T10:29:52.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.270+0000 7f097dffb700 1 -- 172.21.15.161:0/3587478579 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4712 (secure 0 0 0) 0x7f09800582d0 con 0x7f098815b050 2023-08-10T10:29:52.271 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:52.271 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/383745821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":383745821},{"type":"v1","addr":"172.21.15.161:6837","nonce":383745821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1808956168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1808956168},{"type":"v1","addr":"172.21.15.161:6836","nonce":1808956168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/2943847130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2943847130},{"type":"v1","addr":"172.21.15.175:6834","nonce":2943847130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:29:02.890013+0000","modified":"2023-08-10T10:29:06.510357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2919122780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":2919122780},{"type":"v1","addr":"172.21.15.175:6835","nonce":2919122780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:29:52.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 msgr2=0x7f096c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 0x7f096c06d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0984006fd0 tx=0x7f0984008040 comp rx=0 tx=0).stop 2023-08-10T10:29:52.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 msgr2=0x7f09881eddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f098000cd10 tx=0x7f098000a560 comp rx=0 tx=0).stop 2023-08-10T10:29:52.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 shutdown_connections 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f096c06ace0 0x7f096c06d1a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f098815b050 0x7f09881eddf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09880cdd20 0x7f09881f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 --2- 172.21.15.161:0/3587478579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09880d1a40 0x7f098815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 >> 172.21.15.161:0/3587478579 conn(0x7f098809a150 msgr2=0x7f09880c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 shutdown_connections 2023-08-10T10:29:52.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.273+0000 7f098f795700 1 -- 172.21.15.161:0/3587478579 wait complete. 2023-08-10T10:29:52.275 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-08-10T10:29:52.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:29:52.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 Processor -- start 2023-08-10T10:29:52.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 -- start start 2023-08-10T10:29:52.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32e8071940 0x7f32e80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80cf6a0 con 0x7f32e80aea70 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e806ae60 con 0x7f32e806a190 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.405+0000 7f32eed8e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e806eb80 con 0x7f32e8071940 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32e8071940 0x7f32e80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e7fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32e80aea70 0x7f32e806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38514/0 (socket says 172.21.15.161:38514) 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32e8071940 0x7f32e80c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33278/0 (socket says 172.21.15.161:33278) 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e7fff700 1 -- 172.21.15.161:0/3957378203 learned_addr learned my addr 172.21.15.161:0/3957378203 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:52.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 -- 172.21.15.161:0/3957378203 >> v1:172.21.15.175:6789/0 conn(0x7f32e806a190 legacy=0x7f32e806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 -- 172.21.15.161:0/3957378203 >> v1:172.21.15.161:6789/0 conn(0x7f32e80aea70 legacy=0x7f32e806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e77fe700 1 -- 172.21.15.161:0/3957378203 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650752521 0 0) 0x7f32e80cf6a0 con 0x7f32e80aea70 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 -- 172.21.15.161:0/3957378203 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e806e7a0 con 0x7f32e8071940 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32ed32b700 1 --2- 172.21.15.161:0/3957378203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e8071940 0x7f32e80c6810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009d90 tx=0x7f32e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74beb102d3b573dd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e77fe700 1 -- 172.21.15.161:0/3957378203 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e000e070 con 0x7f32e8071940 2023-08-10T10:29:52.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e77fe700 1 -- 172.21.15.161:0/3957378203 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e000bbd0 con 0x7f32e8071940 2023-08-10T10:29:52.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.406+0000 7f32e77fe700 1 -- 172.21.15.161:0/3957378203 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0012430 con 0x7f32e8071940 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 -- 172.21.15.161:0/3957378203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e8071940 msgr2=0x7f32e80c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 --2- 172.21.15.161:0/3957378203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e8071940 0x7f32e80c6810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009d90 tx=0x7f32e000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 -- 172.21.15.161:0/3957378203 shutdown_connections 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 --2- 172.21.15.161:0/3957378203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e8071940 0x7f32e80c6810 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 -- 172.21.15.161:0/3957378203 >> 172.21.15.161:0/3957378203 conn(0x7f32e80cfd70 msgr2=0x7f32e80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 -- 172.21.15.161:0/3957378203 shutdown_connections 2023-08-10T10:29:52.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.407+0000 7f32eed8e700 1 -- 172.21.15.161:0/3957378203 wait complete. 2023-08-10T10:29:52.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.408+0000 7f32eed8e700 1 Processor -- start 2023-08-10T10:29:52.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.408+0000 7f32eed8e700 1 -- start start 2023-08-10T10:29:52.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32e806a190 0x7f32e80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32e8071940 0x7f32e81f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e806ac80 con 0x7f32e80aea70 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815e290 con 0x7f32e8071940 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32eed8e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815d6a0 con 0x7f32e806a190 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33284/0 (socket says 172.21.15.161:33284) 2023-08-10T10:29:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 -- 172.21.15.161:0/49379052 learned_addr learned my addr 172.21.15.161:0/49379052 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32e7fff700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32e8071940 0x7f32e81f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ecb2a700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32e806a190 0x7f32e80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 -- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32e806a190 msgr2=0x7f32e80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32e806a190 0x7f32e80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 -- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32e8071940 msgr2=0x7f32e81f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32e8071940 0x7f32e81f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.409+0000 7f32ed32b700 1 -- 172.21.15.161:0/49379052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009a70 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32ed32b700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e0014040 tx=0x7f32e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e001b810 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0020070 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80cc470 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e001bbb0 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.410+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e815dbd0 con 0x7f32e80aea70 2023-08-10T10:29:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.411+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e815e3d0 con 0x7f32e80aea70 2023-08-10T10:29:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.411+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32e001bd10 con 0x7f32e80aea70 2023-08-10T10:29:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.411+0000 7f32e57fa700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 0x7f32cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.412+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f32e0022070 con 0x7f32e80aea70 2023-08-10T10:29:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.412+0000 7f32ecb2a700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 0x7f32cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.412+0000 7f32ecb2a700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 0x7f32cc06d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000f60 tx=0x7f32dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.416+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f32e00565c0 con 0x7f32e80aea70 2023-08-10T10:29:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.606+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32e80744e0 con 0x7f32e80aea70 2023-08-10T10:29:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.608+0000 7f32e57fa700 1 -- 172.21.15.161:0/49379052 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f32e0059be0 con 0x7f32e80aea70 2023-08-10T10:29:52.608 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:45.529227+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:29:01.426887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:29:01.841430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:29:52.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 msgr2=0x7f32cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 0x7f32cc06d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000f60 tx=0x7f32dc009040 comp rx=0 tx=0).stop 2023-08-10T10:29:52.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 msgr2=0x7f32e80b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e0014040 tx=0x7f32e0004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 shutdown_connections 2023-08-10T10:29:52.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f32cc06ace0 0x7f32cc06d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32e80aea70 0x7f32e80b3480 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32e806a190 0x7f32e80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 --2- 172.21.15.161:0/49379052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32e8071940 0x7f32e81f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 >> 172.21.15.161:0/49379052 conn(0x7f32e80cfd70 msgr2=0x7f32e80ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 shutdown_connections 2023-08-10T10:29:52.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.610+0000 7f32eed8e700 1 -- 172.21.15.161:0/49379052 wait complete. 2023-08-10T10:29:52.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:29:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.743+0000 7f626877c700 1 Processor -- start 2023-08-10T10:29:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.743+0000 7f626877c700 1 -- start start 2023-08-10T10:29:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f626877c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f626006a190 0x7f62600c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f626877c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 0x7f626006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f626877c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600cf6a0 con 0x7f62600aea70 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f626877c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626006eb80 con 0x7f626006a190 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f626877c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600af510 con 0x7f6260071940 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f6266518700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f626006a190 0x7f62600c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f6266d19700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 0x7f626006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f6265d17700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f62600aea70 0x7f626006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:40318/0 (socket says 172.21.15.161:40318) 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.744+0000 7f6265d17700 1 -- 172.21.15.161:0/995954676 learned_addr learned my addr 172.21.15.161:0/995954676 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266518700 1 -- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 msgr2=0x7f626006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266518700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 0x7f626006a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266518700 1 -- 172.21.15.161:0/995954676 >> v1:172.21.15.175:6789/0 conn(0x7f62600aea70 legacy=0x7f626006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266518700 1 -- 172.21.15.161:0/995954676 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626006ae60 con 0x7f626006a190 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6265516700 1 -- 172.21.15.161:0/995954676 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250558290 0 0) 0x7f62600cf6a0 con 0x7f62600aea70 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266d19700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 0x7f626006a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6266518700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f62600c6810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6250009840 tx=0x7f6250009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0ea283f164b3595 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6265516700 1 -- 172.21.15.161:0/995954676 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011830 con 0x7f626006a190 2023-08-10T10:29:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6265516700 1 -- 172.21.15.161:0/995954676 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250011990 con 0x7f626006a190 2023-08-10T10:29:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.745+0000 7f6265516700 1 -- 172.21.15.161:0/995954676 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011d20 con 0x7f626006a190 2023-08-10T10:29:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 -- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 msgr2=0x7f62600c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f62600c6810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6250009840 tx=0x7f6250009b50 comp rx=0 tx=0).stop 2023-08-10T10:29:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 -- 172.21.15.161:0/995954676 shutdown_connections 2023-08-10T10:29:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6260071940 0x7f626006a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 --2- 172.21.15.161:0/995954676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f62600c6810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 -- 172.21.15.161:0/995954676 >> 172.21.15.161:0/995954676 conn(0x7f62600cfd70 msgr2=0x7f62600d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 -- 172.21.15.161:0/995954676 shutdown_connections 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.746+0000 7f626877c700 1 -- 172.21.15.161:0/995954676 wait complete. 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.747+0000 7f626877c700 1 Processor -- start 2023-08-10T10:29:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.747+0000 7f626877c700 1 -- start start 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f6260151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62600aea70 0x7f62601522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626015ea00 con 0x7f6260071940 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626015ece0 con 0x7f626006a190 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626015efc0 con 0x7f62600aea70 2023-08-10T10:29:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33294/0 (socket says 172.21.15.161:33294) 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 -- 172.21.15.161:0/2413017115 learned_addr learned my addr 172.21.15.161:0/2413017115 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6266518700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f6260151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6266d19700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62600aea70 0x7f62601522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 -- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62600aea70 msgr2=0x7f62601522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62600aea70 0x7f62601522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 -- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 msgr2=0x7f6260151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f6260151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 -- 172.21.15.161:0/2413017115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009a70 con 0x7f6260071940 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6265d17700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c540 tx=0x7f625c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c004c80 con 0x7f6260071940 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c004de0 con 0x7f6260071940 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c007310 con 0x7f6260071940 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62500094a0 con 0x7f6260071940 2023-08-10T10:29:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.748+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626015f580 con 0x7f6260071940 2023-08-10T10:29:52.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.749+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626015f7a0 con 0x7f6260071940 2023-08-10T10:29:52.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.750+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f625c007470 con 0x7f6260071940 2023-08-10T10:29:52.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.750+0000 7f6256ffd700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 0x7f624406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:52.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.750+0000 7f6266518700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 0x7f624406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:52.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.750+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f625c0890f0 con 0x7f6260071940 2023-08-10T10:29:52.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.751+0000 7f6266518700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 0x7f624406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f62500090b0 tx=0x7f625001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:52.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.755+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f625c054220 con 0x7f6260071940 2023-08-10T10:29:52.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.983+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62600744e0 con 0x7f6260071940 2023-08-10T10:29:52.984 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-08-10T10:29:52.984+0000 7f5c04dcd700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:29:52.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.988+0000 7f6256ffd700 1 -- 172.21.15.161:0/2413017115 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f625c057840 con 0x7f6260071940 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 msgr2=0x7f624406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 0x7f624406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f62500090b0 tx=0x7f625001c040 comp rx=0 tx=0).stop 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 msgr2=0x7f626015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c540 tx=0x7f625c00c850 comp rx=0 tx=0).stop 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 shutdown_connections 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f624406ace0 0x7f624406d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62600aea70 0x7f62601522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f626006a190 0x7f6260151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.990+0000 7f626877c700 1 --2- 172.21.15.161:0/2413017115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6260071940 0x7f626015a560 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:52.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.991+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 >> 172.21.15.161:0/2413017115 conn(0x7f62600cfd70 msgr2=0x7f626015ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:52.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.991+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 shutdown_connections 2023-08-10T10:29:52.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:52.991+0000 7f626877c700 1 -- 172.21.15.161:0/2413017115 wait complete. 2023-08-10T10:29:52.993 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:29:53.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:29:53.029 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-08-10T10:29:53.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 Processor -- start 2023-08-10T10:29:53.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 -- start start 2023-08-10T10:29:53.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 0x7fc7980ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7980cecb0 0x7fc7980cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980cb7d0 con 0x7fc7980cd900 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980cbd30 con 0x7fc7980cecb0 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.125+0000 7fc79e74a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980cf130 con 0x7fc79815d380 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7980cecb0 0x7fc7980cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7980cecb0 0x7fc7980cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33300/0 (socket says 172.21.15.161:33300) 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 -- 172.21.15.161:0/3904431600 learned_addr learned my addr 172.21.15.161:0/3904431600 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc797fff700 1 --2- 172.21.15.161:0/3904431600 >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 0x7fc7980ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 -- 172.21.15.161:0/3904431600 >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 msgr2=0x7fc7980ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 --2- 172.21.15.161:0/3904431600 >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 0x7fc7980ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 -- 172.21.15.161:0/3904431600 >> v1:172.21.15.175:6789/0 conn(0x7fc7980cd900 legacy=0x7fc79806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 -- 172.21.15.161:0/3904431600 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980acb40 con 0x7fc7980cecb0 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc797fff700 1 --2- 172.21.15.161:0/3904431600 >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 0x7fc7980ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc7977fe700 1 --2- 172.21.15.161:0/3904431600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc7980cd3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc798066ea0 tx=0x7fc780009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa3c86162e42a70 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:53.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc796ffd700 1 -- 172.21.15.161:0/3904431600 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000b870 con 0x7fc7980cecb0 2023-08-10T10:29:53.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc796ffd700 1 -- 172.21.15.161:0/3904431600 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000b9d0 con 0x7fc7980cecb0 2023-08-10T10:29:53.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.126+0000 7fc796ffd700 1 -- 172.21.15.161:0/3904431600 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000bd60 con 0x7fc7980cecb0 2023-08-10T10:29:53.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 -- 172.21.15.161:0/3904431600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 msgr2=0x7fc7980cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 --2- 172.21.15.161:0/3904431600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc7980cd3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc798066ea0 tx=0x7fc780009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 -- 172.21.15.161:0/3904431600 shutdown_connections 2023-08-10T10:29:53.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 --2- 172.21.15.161:0/3904431600 >> v2:172.21.15.175:3300/0 conn(0x7fc79815d380 0x7fc7980ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 --2- 172.21.15.161:0/3904431600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc7980cd3c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 -- 172.21.15.161:0/3904431600 >> 172.21.15.161:0/3904431600 conn(0x7fc7980cf4c0 msgr2=0x7fc7980cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:53.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 -- 172.21.15.161:0/3904431600 shutdown_connections 2023-08-10T10:29:53.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.127+0000 7fc79e74a700 1 -- 172.21.15.161:0/3904431600 wait complete. 2023-08-10T10:29:53.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.128+0000 7fc79e74a700 1 Processor -- start 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.128+0000 7fc79e74a700 1 -- start start 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7980cd900 0x7fc7981586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc79815d380 0x7fc798070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798159260 con 0x7fc7980cecb0 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798159530 con 0x7fc79815d380 2023-08-10T10:29:53.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79e74a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980b34e0 con 0x7fc7980cd900 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33306/0 (socket says 172.21.15.161:33306) 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 -- 172.21.15.161:0/1725651044 learned_addr learned my addr 172.21.15.161:0/1725651044 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc79cce7700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc79815d380 0x7fc798070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc797fff700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7980cd900 0x7fc7981586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 -- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7980cd900 msgr2=0x7fc7981586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7980cd900 0x7fc7981586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 -- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc79815d380 msgr2=0x7fc798070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc79815d380 0x7fc798070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 -- 172.21.15.161:0/1725651044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780009550 con 0x7fc7980cecb0 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.129+0000 7fc7977fe700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc780000c00 tx=0x7fc780004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.130+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7800128c0 con 0x7fc7980cecb0 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.130+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78001e070 con 0x7fc7980cecb0 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.130+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7980b37c0 con 0x7fc7980cecb0 2023-08-10T10:29:53.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.130+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780012c20 con 0x7fc7980cecb0 2023-08-10T10:29:53.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.130+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc798159810 con 0x7fc7980cecb0 2023-08-10T10:29:53.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.131+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7980b3ce0 con 0x7fc7980cecb0 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.131+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc78002d450 con 0x7fc7980cecb0 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.131+0000 7fc794ff9700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 0x7fc77806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.132+0000 7fc797fff700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 0x7fc77806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.132+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fc78008a3e0 con 0x7fc7980cecb0 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.132+0000 7fc797fff700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 0x7fc77806d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7880099d0 tx=0x7fc788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:53.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.136+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc7980b3ce0 con 0x7fc7980cecb0 2023-08-10T10:29:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.370+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc7980b3ce0 con 0x7fc7980cecb0 2023-08-10T10:29:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.989+0000 7fc794ff9700 1 -- 172.21.15.161:0/1725651044 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc7980b3ce0 con 0x7fc7980cecb0 2023-08-10T10:29:53.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 msgr2=0x7fc77806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 0x7fc77806d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7880099d0 tx=0x7fc788008040 comp rx=0 tx=0).stop 2023-08-10T10:29:53.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 msgr2=0x7fc798158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc780000c00 tx=0x7fc780004750 comp rx=0 tx=0).stop 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 shutdown_connections 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fc77806ace0 0x7fc77806d1a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc79815d380 0x7fc798070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7980cd900 0x7fc7981586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 --2- 172.21.15.161:0/1725651044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7980cecb0 0x7fc798158d20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:53.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 >> 172.21.15.161:0/1725651044 conn(0x7fc7980cf4c0 msgr2=0x7fc7980afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:53.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 shutdown_connections 2023-08-10T10:29:53.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:53.992+0000 7fc79e74a700 1 -- 172.21.15.161:0/1725651044 wait complete. 2023-08-10T10:29:54.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:29:54.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.132+0000 7f02dc4cb700 1 Processor -- start 2023-08-10T10:29:54.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.132+0000 7f02dc4cb700 1 -- start start 2023-08-10T10:29:54.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02dc4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02d40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02dc4cb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d415b290 con 0x7f02d4071d10 2023-08-10T10:29:54.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02dc4cb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d415b570 con 0x7f02d406e650 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02dc4cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40c5890 con 0x7f02d4154620 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9a66700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f02d4071d10 0x7f02d406df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38550/0 (socket says 172.21.15.161:38550) 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9a66700 1 -- 172.21.15.161:0/2505246709 learned_addr learned my addr 172.21.15.161:0/2505246709 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02da267700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02d40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092654950 0 0) 0x7f02d415b290 con 0x7f02d4071d10 2023-08-10T10:29:54.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c00035b0 con 0x7f02d4071d10 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374533301 0 0) 0x7f02c00035b0 con 0x7f02d4071d10 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 msgr2=0x7f02d40717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02d40717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.133+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 >> v1:172.21.15.175:6789/0 conn(0x7f02d406e650 legacy=0x7f02d415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4070cf0 con 0x7f02d4071d10 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f02c4001670 con 0x7f02d4071d10 2023-08-10T10:29:54.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 >> v1:172.21.15.161:6789/0 conn(0x7f02d4071d10 legacy=0x7f02d406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02c0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c0003f70 0x7f02c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02c0004d90 0x7f02c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40c5890 con 0x7f02c0003f70 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c000ba70 con 0x7f02c0004d90 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c000bc30 con 0x7f02d4154620 2023-08-10T10:29:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c0003f70 0x7f02c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02da267700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02c0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02daa68700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02c0004d90 0x7f02c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 -- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 msgr2=0x7f02c0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d4154620 0x7f02c0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 -- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02c0004d90 msgr2=0x7f02c0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02c0004d90 0x7f02c0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 -- 172.21.15.161:0/2505246709 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00035b0 con 0x7f02c0003f70 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9a66700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c0003f70 0x7f02c0004850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c2f0 tx=0x7f02c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e820bb3ad948cea6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400cd70 con 0x7f02c0003f70 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4005960 con 0x7f02c0003f70 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.134+0000 7f02d9265700 1 -- 172.21.15.161:0/2505246709 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4005d10 con 0x7f02c0003f70 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 -- 172.21.15.161:0/2505246709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c0003f70 msgr2=0x7f02c0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/2505246709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c0003f70 0x7f02c0004850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c2f0 tx=0x7f02c0005880 comp rx=0 tx=0).stop 2023-08-10T10:29:54.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02daa68700 1 -- 172.21.15.161:0/2505246709 reap_dead start 2023-08-10T10:29:54.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 -- 172.21.15.161:0/2505246709 shutdown_connections 2023-08-10T10:29:54.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 -- 172.21.15.161:0/2505246709 >> 172.21.15.161:0/2505246709 conn(0x7f02d40cfd70 msgr2=0x7f02d40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:54.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 -- 172.21.15.161:0/2505246709 shutdown_connections 2023-08-10T10:29:54.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.135+0000 7f02dc4cb700 1 -- 172.21.15.161:0/2505246709 wait complete. 2023-08-10T10:29:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.136+0000 7f02dc4cb700 1 Processor -- start 2023-08-10T10:29:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.136+0000 7f02dc4cb700 1 -- start start 2023-08-10T10:29:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02c0003f70 0x7f02d40b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d41f2360 0x7f02d406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4143870 con 0x7f02d4143410 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41f6170 con 0x7f02d41f2360 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02dc4cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41f63c0 con 0x7f02c0003f70 2023-08-10T10:29:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33326/0 (socket says 172.21.15.161:33326) 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 -- 172.21.15.161:0/377824903 learned_addr learned my addr 172.21.15.161:0/377824903 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02da267700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02c0003f70 0x7f02d40b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02daa68700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d41f2360 0x7f02d406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 -- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02c0003f70 msgr2=0x7f02d40b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02c0003f70 0x7f02d40b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 -- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d41f2360 msgr2=0x7f02d406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d41f2360 0x7f02d406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 -- 172.21.15.161:0/377824903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d41f66a0 con 0x7f02d4143410 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.137+0000 7f02d9a66700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02c000ba40 tx=0x7f02c4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.138+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4004a80 con 0x7f02d4143410 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.138+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4004be0 con 0x7f02d4143410 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.138+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40070d0 con 0x7f02d4143410 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.138+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d41f6980 con 0x7f02d4143410 2023-08-10T10:29:54.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.138+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d41f6f40 con 0x7f02d4143410 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.139+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d40744e0 con 0x7f02d4143410 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.139+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02c4007230 con 0x7f02d4143410 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.139+0000 7f02caffd700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 0x7f02b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.139+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f02c408ab90 con 0x7f02d4143410 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.139+0000 7f02da267700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 0x7f02b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:54.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.140+0000 7f02da267700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 0x7f02b806d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02d40b0f10 tx=0x7f02d0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:54.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.144+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f02c4055d00 con 0x7f02d4143410 2023-08-10T10:29:54.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.336+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02d4071770 con 0x7f02d4143410 2023-08-10T10:29:54.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.993+0000 7f02caffd700 1 -- 172.21.15.161:0/377824903 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f02c40170d0 con 0x7f02d4143410 2023-08-10T10:29:54.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 msgr2=0x7f02b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 0x7f02b806d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02d40b0f10 tx=0x7f02d0009210 comp rx=0 tx=0).stop 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 msgr2=0x7f02d41f3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02c000ba40 tx=0x7f02c4001a00 comp rx=0 tx=0).stop 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 shutdown_connections 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f02b806ace0 0x7f02b806d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d41f2360 0x7f02d406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02c0003f70 0x7f02d40b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 --2- 172.21.15.161:0/377824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d4143410 0x7f02d41f3600 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:54.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 >> 172.21.15.161:0/377824903 conn(0x7f02d40cfd70 msgr2=0x7f02d4153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:55.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 shutdown_connections 2023-08-10T10:29:55.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:54.997+0000 7f02dc4cb700 1 -- 172.21.15.161:0/377824903 wait complete. 2023-08-10T10:29:55.000 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:29:55.011 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:29:55.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.137+0000 7f5108ac0700 1 Processor -- start 2023-08-10T10:29:55.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.137+0000 7f5108ac0700 1 -- start start 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f510415b050 0x7f51040d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040d1a40 0x7f51040cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f51040ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040ccd40 con 0x7f51040d1a40 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040ce130 con 0x7f510415b050 2023-08-10T10:29:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5108ac0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040cc780 con 0x7f51040cdd20 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5101d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040d1a40 0x7f51040cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5101d9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040d1a40 0x7f51040cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33332/0 (socket says 172.21.15.161:33332) 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.138+0000 7f5101d9b700 1 -- 172.21.15.161:0/3669098110 learned_addr learned my addr 172.21.15.161:0/3669098110 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5102d9d700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f51040ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f510259c700 1 --2- 172.21.15.161:0/3669098110 >> v2:172.21.15.175:3300/0 conn(0x7f510415b050 0x7f51040d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 -- 172.21.15.161:0/3669098110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 msgr2=0x7f51040ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:55.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f51040ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 -- 172.21.15.161:0/3669098110 >> v2:172.21.15.175:3300/0 conn(0x7f510415b050 msgr2=0x7f51040d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 --2- 172.21.15.161:0/3669098110 >> v2:172.21.15.175:3300/0 conn(0x7f510415b050 0x7f51040d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 -- 172.21.15.161:0/3669098110 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040cca60 con 0x7f51040d1a40 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f5101d9b700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51040cd7e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f510409a880 tx=0x7f50f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c8e207d9bbd3a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f510159a700 1 -- 172.21.15.161:0/3669098110 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400b870 con 0x7f51040d1a40 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f510159a700 1 -- 172.21.15.161:0/3669098110 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400b9d0 con 0x7f51040d1a40 2023-08-10T10:29:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.139+0000 7f510159a700 1 -- 172.21.15.161:0/3669098110 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400bd60 con 0x7f51040d1a40 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 -- 172.21.15.161:0/3669098110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 msgr2=0x7f51040cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51040cd7e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f510409a880 tx=0x7f50f4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 -- 172.21.15.161:0/3669098110 shutdown_connections 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f51040ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 --2- 172.21.15.161:0/3669098110 >> v2:172.21.15.175:3300/0 conn(0x7f510415b050 0x7f51040d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 --2- 172.21.15.161:0/3669098110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51040cd7e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 -- 172.21.15.161:0/3669098110 >> 172.21.15.161:0/3669098110 conn(0x7f510409a150 msgr2=0x7f51040d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 -- 172.21.15.161:0/3669098110 shutdown_connections 2023-08-10T10:29:55.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.140+0000 7f5108ac0700 1 -- 172.21.15.161:0/3669098110 wait complete. 2023-08-10T10:29:55.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.141+0000 7f5108ac0700 1 Processor -- start 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.141+0000 7f5108ac0700 1 -- start start 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f510414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f510415b050 0x7f5104158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041f6250 con 0x7f51040d1a40 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041f64f0 con 0x7f510415b050 2023-08-10T10:29:55.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5108ac0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51041f67d0 con 0x7f51040cdd20 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33340/0 (socket says 172.21.15.161:33340) 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 -- 172.21.15.161:0/2657849540 learned_addr learned my addr 172.21.15.161:0/2657849540 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5102d9d700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f510415b050 0x7f5104158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f510259c700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f510414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 -- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 msgr2=0x7f510414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:55.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f510414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 -- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f510415b050 msgr2=0x7f5104158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f510415b050 0x7f5104158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 -- 172.21.15.161:0/2657849540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009550 con 0x7f51040d1a40 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.142+0000 7f5101d9b700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000c00 tx=0x7f50f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.143+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4004480 con 0x7f51040d1a40 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.143+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40045e0 con 0x7f51040d1a40 2023-08-10T10:29:55.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.143+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51041f6ab0 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.143+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f40038e0 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.143+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104151080 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.144+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51041f6fd0 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.144+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f50f4021070 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.145+0000 7f50f2ffd700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 0x7f50e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.145+0000 7f510259c700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 0x7f50e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.145+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f50f408a930 con 0x7f51040d1a40 2023-08-10T10:29:55.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.145+0000 7f510259c700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 0x7f50e406d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50f8006fd0 tx=0x7f50f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:55.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.149+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51041f6fd0 con 0x7f51040d1a40 2023-08-10T10:29:55.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.337+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51041f6fd0 con 0x7f51040d1a40 2023-08-10T10:29:55.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:55.999+0000 7f50f2ffd700 1 -- 172.21.15.161:0/2657849540 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f51041f6fd0 con 0x7f51040d1a40 2023-08-10T10:29:56.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 msgr2=0x7f50e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 0x7f50e406d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50f8006fd0 tx=0x7f50f8008040 comp rx=0 tx=0).stop 2023-08-10T10:29:56.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 msgr2=0x7f51041583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000c00 tx=0x7f50f4004750 comp rx=0 tx=0).stop 2023-08-10T10:29:56.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 shutdown_connections 2023-08-10T10:29:56.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f50e406ace0 0x7f50e406d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f510415b050 0x7f5104158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51040cdd20 0x7f510414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 --2- 172.21.15.161:0/2657849540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040d1a40 0x7f51041583d0 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000c00 tx=0x7f50f4004750 comp rx=0 tx=0).stop 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.002+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 >> 172.21.15.161:0/2657849540 conn(0x7f510409a150 msgr2=0x7f51040c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.003+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 shutdown_connections 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.003+0000 7f5108ac0700 1 -- 172.21.15.161:0/2657849540 wait complete. 2023-08-10T10:29:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2023-08-10T10:29:56.018 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:29:56.018 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:29:56.018 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:29:56.018 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:29:56.019 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:29:56.019 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:29:56.019 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:29:56.019 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:29:56.020 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:29:56.020 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:29:56.020 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:29:56.020 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:29:56.021 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:29:56.021 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:29:56.021 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:29:56.021 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:29:56.029 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:29:56.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:29:56.030 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:29:56.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:29:56.032 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:29:56.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:29:56.033 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:29:56.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:29:56.072 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:29:56.073 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:56.074 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:29:56.074 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:56.075 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:29:56.075 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:56.076 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:29:56.076 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:56.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:29:56.154 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-08-10T10:29:56.154 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-08-10T10:29:56.158 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-08-10T10:29:56.158 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-08-10T10:29:56.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.206+0000 7f7d0476d700 1 Processor -- start 2023-08-10T10:29:56.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.206+0000 7f7d0476d700 1 -- start start 2023-08-10T10:29:56.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d0476d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 0x7f7cfc0717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d0476d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 0x7f7cfc15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d0476d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc15b290 con 0x7f7cfc071d10 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d0476d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc0c5890 con 0x7f7cfc154620 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d0476d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc15b570 con 0x7f7cfc06e650 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d01d08700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7cfc071d10 0x7f7cfc06df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38610/0 (socket says 172.21.15.161:38610) 2023-08-10T10:29:56.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d01d08700 1 -- 172.21.15.161:0/3968808787 learned_addr learned my addr 172.21.15.161:0/3968808787 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02d0a700 1 --2- 172.21.15.161:0/3968808787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 0x7f7cfc15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02509700 1 --2- 172.21.15.161:0/3968808787 >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 0x7f7cfc0717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794891712 0 0) 0x7f7cfc15b290 con 0x7f7cfc071d10 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80035b0 con 0x7f7cfc071d10 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02d0a700 1 -- 172.21.15.161:0/3968808787 >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 msgr2=0x7f7cfc0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332325740 0 0) 0x7f7ce80035b0 con 0x7f7cfc071d10 2023-08-10T10:29:56.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02d0a700 1 --2- 172.21.15.161:0/3968808787 >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 0x7f7cfc0717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02d0a700 1 -- 172.21.15.161:0/3968808787 >> v1:172.21.15.161:6789/0 conn(0x7f7cfc071d10 legacy=0x7f7cfc06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02d0a700 1 -- 172.21.15.161:0/3968808787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc070cf0 con 0x7f7cfc06e650 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.207+0000 7f7d02509700 1 --2- 172.21.15.161:0/3968808787 >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 0x7f7cfc0717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d02d0a700 1 --2- 172.21.15.161:0/3968808787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 0x7f7cfc15a5c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009d90 tx=0x7f7cf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e52900763c8a9d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400e070 con 0x7f7cfc06e650 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4003a20 con 0x7f7cfc06e650 2023-08-10T10:29:56.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d01507700 1 -- 172.21.15.161:0/3968808787 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec001670 con 0x7f7cfc06e650 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 -- 172.21.15.161:0/3968808787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 msgr2=0x7f7cfc15a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 --2- 172.21.15.161:0/3968808787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 0x7f7cfc15a5c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009d90 tx=0x7f7cf400b330 comp rx=0 tx=0).stop 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 -- 172.21.15.161:0/3968808787 shutdown_connections 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 --2- 172.21.15.161:0/3968808787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc06e650 0x7f7cfc15a5c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 --2- 172.21.15.161:0/3968808787 >> v2:172.21.15.175:3300/0 conn(0x7f7cfc154620 0x7f7cfc0717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 -- 172.21.15.161:0/3968808787 >> 172.21.15.161:0/3968808787 conn(0x7f7cfc0cfd70 msgr2=0x7f7cfc0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:56.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 -- 172.21.15.161:0/3968808787 shutdown_connections 2023-08-10T10:29:56.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.208+0000 7f7d0476d700 1 -- 172.21.15.161:0/3968808787 wait complete. 2023-08-10T10:29:56.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 Processor -- start 2023-08-10T10:29:56.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 -- start start 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc071d10 0x7f7cfc1e4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cfc154620 0x7f7cfc1e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b0050 con 0x7f7cfc06e650 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc149f00 con 0x7f7cfc154620 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d0476d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc1f0620 con 0x7f7cfc071d10 2023-08-10T10:29:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d02509700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d02509700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33376/0 (socket says 172.21.15.161:33376) 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.210+0000 7f7d02509700 1 -- 172.21.15.161:0/1450755730 learned_addr learned my addr 172.21.15.161:0/1450755730 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d01d08700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc071d10 0x7f7cfc1e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02d0a700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cfc154620 0x7f7cfc1e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 -- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc071d10 msgr2=0x7f7cfc1e4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc071d10 0x7f7cfc1e4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 -- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cfc154620 msgr2=0x7f7cfc1e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cfc154620 0x7f7cfc1e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 -- 172.21.15.161:0/1450755730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80094a0 con 0x7f7cfc06e650 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d02509700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800ebe0 tx=0x7f7cf800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8009760 con 0x7f7cfc06e650 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800c850 con 0x7f7cfc06e650 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4009a70 con 0x7f7cfc06e650 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800cbe0 con 0x7f7cfc06e650 2023-08-10T10:29:56.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.211+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc1e53f0 con 0x7f7cfc06e650 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.212+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc0b0190 con 0x7f7cfc06e650 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.213+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cf800cd40 con 0x7f7cfc06e650 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.213+0000 7f7cf2ffd700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 0x7f7ce006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.213+0000 7f7d01d08700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 0x7f7ce006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.213+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7cf8089180 con 0x7f7cfc06e650 2023-08-10T10:29:56.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.214+0000 7f7d01d08700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 0x7f7ce006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cec001820 tx=0x7f7cec0012b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:56.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.217+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7cf8054540 con 0x7f7cfc06e650 2023-08-10T10:29:56.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:56.434+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7cfc0744e0 con 0x7f7cfc06e650 2023-08-10T10:29:57.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.013+0000 7f7cf2ffd700 1 -- 172.21.15.161:0/1450755730 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7cf8057b60 con 0x7f7cfc06e650 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 msgr2=0x7f7ce006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 0x7f7ce006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cec001820 tx=0x7f7cec0012b0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 msgr2=0x7f7cfc1499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800ebe0 tx=0x7f7cf800eef0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 shutdown_connections 2023-08-10T10:29:57.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ce006ace0 0x7f7ce006d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cfc154620 0x7f7cfc1e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cfc06e650 0x7f7cfc1499c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 --2- 172.21.15.161:0/1450755730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cfc071d10 0x7f7cfc1e4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 >> 172.21.15.161:0/1450755730 conn(0x7f7cfc0cfd70 msgr2=0x7f7cfc06db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.015+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 shutdown_connections 2023-08-10T10:29:57.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.016+0000 7f7d0476d700 1 -- 172.21.15.161:0/1450755730 wait complete. 2023-08-10T10:29:57.018 INFO:teuthology.orchestra.run.smithi161.stderr: removed all blocklist entries 2023-08-10T10:29:57.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:29:57.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.155+0000 7f3919175700 1 Processor -- start 2023-08-10T10:29:57.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.155+0000 7f3919175700 1 -- start start 2023-08-10T10:29:57.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3919175700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 0x7f39140d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3919175700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140d1680 con 0x7f39140cf960 2023-08-10T10:29:57.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3919175700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140d1960 con 0x7f39140d0450 2023-08-10T10:29:57.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3919175700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39140d1c40 con 0x7f391415d540 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3912d9d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f39140cf960 0x7f39140cfd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38624/0 (socket says 172.21.15.161:38624) 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3912d9d700 1 -- 172.21.15.161:0/3729460140 learned_addr learned my addr 172.21.15.161:0/3729460140 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f391259c700 1 --2- 172.21.15.161:0/3729460140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 0x7f39140d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541604833 0 0) 0x7f39140d1680 con 0x7f39140cf960 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38fc0035b0 con 0x7f39140cf960 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480281852 0 0) 0x7f39140d1960 con 0x7f39140d0450 2023-08-10T10:29:57.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39140d1680 con 0x7f39140d0450 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f391259c700 1 -- 172.21.15.161:0/3729460140 >> v1:172.21.15.175:6789/0 conn(0x7f39140d0450 legacy=0x7f39140b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930293761 0 0) 0x7f38fc0035b0 con 0x7f39140cf960 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f391259c700 1 -- 172.21.15.161:0/3729460140 >> v1:172.21.15.161:6789/0 conn(0x7f39140cf960 legacy=0x7f39140cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f391259c700 1 -- 172.21.15.161:0/3729460140 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140d1f20 con 0x7f391415d540 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.156+0000 7f391259c700 1 --2- 172.21.15.161:0/3729460140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 0x7f39140d3b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3908009870 tx=0x7f3908009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61edea8f0dcea708 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040017f0 con 0x7f391415d540 2023-08-10T10:29:57.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908004030 con 0x7f391415d540 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3911d9b700 1 -- 172.21.15.161:0/3729460140 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080043c0 con 0x7f391415d540 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 -- 172.21.15.161:0/3729460140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 msgr2=0x7f39140d3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 --2- 172.21.15.161:0/3729460140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 0x7f39140d3b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3908009870 tx=0x7f3908009b80 comp rx=0 tx=0).stop 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 -- 172.21.15.161:0/3729460140 shutdown_connections 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 --2- 172.21.15.161:0/3729460140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f391415d540 0x7f39140d3b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 -- 172.21.15.161:0/3729460140 >> 172.21.15.161:0/3729460140 conn(0x7f39140d3000 msgr2=0x7f39140d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:57.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 -- 172.21.15.161:0/3729460140 shutdown_connections 2023-08-10T10:29:57.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.157+0000 7f3919175700 1 -- 172.21.15.161:0/3729460140 wait complete. 2023-08-10T10:29:57.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 Processor -- start 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 -- start start 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39140d0450 0x7f3914151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391415d540 0x7f39141f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140b8b40 con 0x7f39140cf960 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391415f070 con 0x7f391415d540 2023-08-10T10:29:57.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3919175700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391415e460 con 0x7f39140d0450 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3912d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3912d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33392/0 (socket says 172.21.15.161:33392) 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.159+0000 7f3912d9d700 1 -- 172.21.15.161:0/878313237 learned_addr learned my addr 172.21.15.161:0/878313237 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f391259c700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39140d0450 0x7f3914151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f391359e700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391415d540 0x7f39141f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 -- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39140d0450 msgr2=0x7f3914151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39140d0450 0x7f3914151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 -- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391415d540 msgr2=0x7f39141f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391415d540 0x7f39141f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 -- 172.21.15.161:0/878313237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080094a0 con 0x7f39140cf960 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3912d9d700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f390400c750 tx=0x7f390400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040074e0 con 0x7f39140cf960 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904007640 con 0x7f39140cf960 2023-08-10T10:29:57.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391415e740 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005a50 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.160+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391415ed00 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.161+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39140744e0 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.162+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3904005bb0 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.162+0000 7f38fb7fe700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 0x7f390006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.162+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3904088610 con 0x7f39140cf960 2023-08-10T10:29:57.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.162+0000 7f391259c700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 0x7f390006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.162+0000 7f391259c700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 0x7f390006d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3908009870 tx=0x7f3908008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.166+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3904053a10 con 0x7f39140cf960 2023-08-10T10:29:57.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.427+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f391406c8b0 con 0x7f39140cf960 2023-08-10T10:29:57.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.428+0000 7f38fb7fe700 1 -- 172.21.15.161:0/878313237 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3904005e60 con 0x7f39140cf960 2023-08-10T10:29:57.428 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:29:57.428 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-08-10T10:29:57.428 INFO:teuthology.orchestra.run.smithi161.stdout: "auth_dump": [ 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.a", 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC0u9Rk4hf5NhAABDudX5WuXCUCX6/b5FzeqA==", 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.b", 2023-08-10T10:29:57.430 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9RkwCzPBxAA5QE5xgkVUH8zLiJ7U/FwfA==", 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.431 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.c", 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9RkWqC2AhAAX+sz3tw1o5AzTnwO/i/00w==", 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-08-10T10:29:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.d", 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9RkiXBEDxAAdz/D2bYIQpb/jBLDU2WbmA==", 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.433 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.0", 2023-08-10T10:29:57.434 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC4u9RkhrBOKRAA1Gnrlfw347KrNlnZ6EaCkg==", 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.435 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.1", 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC7u9RkM72PKBAAiZL/W/bW7wQof5EqanYSPg==", 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.436 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.2", 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC+u9RktHKPJxAAMn6VWWHMiYZKUJSDvtycAQ==", 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.437 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.3", 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDBu9RkDFZ9JxAAymZXEREJ56qzs9b54DR1pg==", 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.438 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.4", 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDHu9Rk5M5oKhAAz4oHySLquHN0ys1M4yFyzw==", 2023-08-10T10:29:57.439 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.5", 2023-08-10T10:29:57.440 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDKu9Rkg+NHKhAArOo8iMCwOXWzXjjVVevbYw==", 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.6", 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDNu9Rko693KRAAtWPCq3ejpC4hncanrCsTbw==", 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.7", 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQu9Rkk+itKBAA6rbePsSNcKrJes/wJEqq1g==", 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.443 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.0", 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9RkxHySExAA2njciOh3wsl4O4q2eSwlJg==", 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-08-10T10:29:57.444 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.1", 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9Rk7BBHGhAAHHH/tOnTr1GVl8+INqvDZw==", 2023-08-10T10:29:57.445 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.446 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.2", 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9RkY9LqFhAAAyKC8/QvBdbxxDEa4AfnhA==", 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.3", 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC1u9Rk63G7HRAA31xKSf623Ix72EDYgTE4Pg==", 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-08-10T10:29:57.448 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.admin", 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw==", 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.449 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mds", 2023-08-10T10:29:57.450 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9RkeqqMJRAAeNbocvUATp98U72ilY9R5g==", 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mds" 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mgr", 2023-08-10T10:29:57.451 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9RkwrKMJRAAzmwwFuskVmebjSHJG/1JJQ==", 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-osd", 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9Rk0LqMJRAAyQSBi1vptMQXFUVq+jMnkw==", 2023-08-10T10:29:57.452 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-osd" 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd", 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9RkhsGMJRAA6IRntczJupWIdluKuFd8Xw==", 2023-08-10T10:29:57.453 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9RkfsiMJRAAKquIMBV1z/DnD5I94Dceog==", 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.454 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rgw", 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWu9Rkuc+MJRAAH4Y+pstRsdsz3wfmd4Yb6w==", 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-10T10:29:57.455 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.x", 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC0u9Rk2CWgMxAA5JR8LboZnHWzk7eeUxeHnQ==", 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-08-10T10:29:57.456 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.y", 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQC0u9RkGrfpLhAArjhcAInUtQEZ/GksarmS0g==", 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-08-10T10:29:57.457 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-08-10T10:29:57.458 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-08-10T10:29:57.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 msgr2=0x7f390006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 0x7f390006d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3908009870 tx=0x7f3908008030 comp rx=0 tx=0).stop 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 msgr2=0x7f39140ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f390400c750 tx=0x7f390400ca60 comp rx=0 tx=0).stop 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 shutdown_connections 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f390006ace0 0x7f390006d1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391415d540 0x7f39141f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39140cf960 0x7f39140ccfe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 --2- 172.21.15.161:0/878313237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39140d0450 0x7f3914151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.429+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 >> 172.21.15.161:0/878313237 conn(0x7f39140d3000 msgr2=0x7f391406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:57.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.430+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 shutdown_connections 2023-08-10T10:29:57.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.430+0000 7f3919175700 1 -- 172.21.15.161:0/878313237 wait complete. 2023-08-10T10:29:57.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-10T10:29:57.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.583+0000 7f4d55575700 1 Processor -- start 2023-08-10T10:29:57.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.583+0000 7f4d55575700 1 -- start start 2023-08-10T10:29:57.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d55575700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d501596d0 0x7f4d500cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d55575700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d500ca050 0x7f4d5006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d55575700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d500cd5c0 con 0x7f4d5006c270 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d55575700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5006cc30 con 0x7f4d500ca050 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d55575700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500cdf90 con 0x7f4d501596d0 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d500ca050 0x7f4d5006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d500ca050 0x7f4d5006c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33404/0 (socket says 172.21.15.161:33404) 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/525176334 learned_addr learned my addr 172.21.15.161:0/525176334 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:57.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4effd700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d501596d0 0x7f4d500cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/525176334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d501596d0 msgr2=0x7f4d500cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d501596d0 0x7f4d500cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/525176334 >> v1:172.21.15.175:6789/0 conn(0x7f4d5006c270 legacy=0x7f4d500c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/525176334 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500cc9b0 con 0x7f4d500ca050 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4dffb700 1 -- 172.21.15.161:0/525176334 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151737715 0 0) 0x7f4d500cd5c0 con 0x7f4d5006c270 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4f7fe700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d500ca050 0x7f4d5006c6f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800d150 tx=0x7f4d4800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700ceafefffe25e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4dffb700 1 -- 172.21.15.161:0/525176334 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48010070 con 0x7f4d500ca050 2023-08-10T10:29:57.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4dffb700 1 -- 172.21.15.161:0/525176334 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800db00 con 0x7f4d500ca050 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.584+0000 7f4d4dffb700 1 -- 172.21.15.161:0/525176334 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48016400 con 0x7f4d500ca050 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 -- 172.21.15.161:0/525176334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d500ca050 msgr2=0x7f4d5006c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d500ca050 0x7f4d5006c6f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800d150 tx=0x7f4d4800d460 comp rx=0 tx=0).stop 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 -- 172.21.15.161:0/525176334 shutdown_connections 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d500ca050 0x7f4d5006c6f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 --2- 172.21.15.161:0/525176334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d501596d0 0x7f4d500cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 -- 172.21.15.161:0/525176334 >> 172.21.15.161:0/525176334 conn(0x7f4d500cec40 msgr2=0x7f4d500cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:57.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 -- 172.21.15.161:0/525176334 shutdown_connections 2023-08-10T10:29:57.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.585+0000 7f4d55575700 1 -- 172.21.15.161:0/525176334 wait complete. 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.586+0000 7f4d55575700 1 Processor -- start 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.586+0000 7f4d55575700 1 -- start start 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 0x7f4d50156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 0x7f4d50157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d501571f0 con 0x7f4d501596d0 2023-08-10T10:29:57.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d501565e0 con 0x7f4d500ca050 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d55575700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d501568c0 con 0x7f4d5006c270 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d4f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d4f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33410/0 (socket says 172.21.15.161:33410) 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/345077763 learned_addr learned my addr 172.21.15.161:0/345077763 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d4effd700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 0x7f4d50156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.587+0000 7f4d4e7fc700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 0x7f4d50157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 msgr2=0x7f4d50156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 0x7f4d50156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 msgr2=0x7f4d50157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 0x7f4d50157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 -- 172.21.15.161:0/345077763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4800bd40 con 0x7f4d501596d0 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4effd700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 0x7f4d50156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4e7fc700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 0x7f4d50157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:57.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d4f7fe700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d50068430 tx=0x7f4d48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480176c0 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48017840 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48017bf0 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d50156ba0 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.588+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d50158d10 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.589+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d50157360 con 0x7f4d501596d0 2023-08-10T10:29:57.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.589+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d48017d50 con 0x7f4d501596d0 2023-08-10T10:29:57.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.590+0000 7f4d377fe700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 0x7f4d3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:57.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.590+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d4808ab20 con 0x7f4d501596d0 2023-08-10T10:29:57.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.590+0000 7f4d4effd700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 0x7f4d3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:57.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.590+0000 7f4d4effd700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 0x7f4d3c06d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009b90 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:57.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.594+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d48055fb0 con 0x7f4d501596d0 2023-08-10T10:29:57.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.858+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4d500744e0 con 0x7f4d501596d0 2023-08-10T10:29:57.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.862+0000 7f4d377fe700 1 -- 172.21.15.161:0/345077763 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d480595d0 con 0x7f4d501596d0 2023-08-10T10:29:57.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 msgr2=0x7f4d3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 0x7f4d3c06d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009b90 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2023-08-10T10:29:57.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 msgr2=0x7f4d501587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d50068430 tx=0x7f4d48004ad0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 shutdown_connections 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f4d3c06ace0 0x7f4d3c06d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d501596d0 0x7f4d501587d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d5006c270 0x7f4d50156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 --2- 172.21.15.161:0/345077763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d500ca050 0x7f4d50157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:57.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 >> 172.21.15.161:0/345077763 conn(0x7f4d500cec40 msgr2=0x7f4d50155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:57.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 shutdown_connections 2023-08-10T10:29:57.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.864+0000 7f4d55575700 1 -- 172.21.15.161:0/345077763 wait complete. 2023-08-10T10:29:57.876 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-10T10:29:57.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.997+0000 7ff59e6d9700 1 Processor -- start 2023-08-10T10:29:57.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.997+0000 7ff59e6d9700 1 -- start start 2023-08-10T10:29:58.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59e6d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff59806a190 0x7ff5980c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59e6d9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980cf6a0 con 0x7ff598071940 2023-08-10T10:29:58.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59e6d9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59806ae60 con 0x7ff5980aea70 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59e6d9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59806eb80 con 0x7ff59806a190 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59cc76700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff598071940 0x7ff59806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38656/0 (socket says 172.21.15.161:38656) 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff59cc76700 1 -- 172.21.15.161:0/2393941836 learned_addr learned my addr 172.21.15.161:0/2393941836 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff597fff700 1 --2- 172.21.15.161:0/2393941836 >> v2:172.21.15.175:3300/0 conn(0x7ff59806a190 0x7ff5980c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635482749 0 0) 0x7ff5980cf6a0 con 0x7ff598071940 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5800035b0 con 0x7ff598071940 2023-08-10T10:29:58.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955950855 0 0) 0x7ff5800035b0 con 0x7ff598071940 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 >> v2:172.21.15.175:3300/0 conn(0x7ff59806a190 msgr2=0x7ff5980c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 --2- 172.21.15.161:0/2393941836 >> v2:172.21.15.175:3300/0 conn(0x7ff59806a190 0x7ff5980c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 >> v1:172.21.15.175:6789/0 conn(0x7ff5980aea70 legacy=0x7ff59806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59806e7a0 con 0x7ff598071940 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7ff5900019f0 con 0x7ff598071940 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 >> v1:172.21.15.161:6789/0 conn(0x7ff598071940 legacy=0x7ff59806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff580003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff580004850 0x7ff580004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff580005210 0x7ff58000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59806eb80 con 0x7ff580003a00 2023-08-10T10:29:58.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58000c0b0 con 0x7ff580004850 2023-08-10T10:29:58.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58000c270 con 0x7ff580005210 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.998+0000 7ff597fff700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff580003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff580004850 0x7ff580004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff59cc76700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff580005210 0x7ff58000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 -- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff580005210 msgr2=0x7ff58000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff580005210 0x7ff58000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 -- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff580004850 msgr2=0x7ff580004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff580004850 0x7ff580004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff59cc76700 1 -- 172.21.15.161:0/2393941836 reap_dead start 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 -- 172.21.15.161:0/2393941836 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800035b0 con 0x7ff580003a00 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff580004850 0x7ff580004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff597fff700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff580003e20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff588009b60 tx=0x7ff580005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c0f73174482be9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800e6c0 con 0x7ff580003a00 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58800e820 con 0x7ff580003a00 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:57.999+0000 7ff596ffd700 1 -- 172.21.15.161:0/2393941836 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800eb90 con 0x7ff580003a00 2023-08-10T10:29:58.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 msgr2=0x7ff580003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff580003e20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff588009b60 tx=0x7ff580005880 comp rx=0 tx=0).stop 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2393941836 shutdown_connections 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2393941836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff580003e20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2393941836 >> 172.21.15.161:0/2393941836 conn(0x7ff5980cfd70 msgr2=0x7ff5980d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2393941836 shutdown_connections 2023-08-10T10:29:58.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.000+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2393941836 wait complete. 2023-08-10T10:29:58.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.001+0000 7ff59e6d9700 1 Processor -- start 2023-08-10T10:29:58.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.001+0000 7ff59e6d9700 1 -- start start 2023-08-10T10:29:58.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 0x7ff5980b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5981f6220 0x7ff5981f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59806ac80 con 0x7ff580003a00 2023-08-10T10:29:58.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981f6f70 con 0x7ff5981f6220 2023-08-10T10:29:58.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59e6d9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b1450 con 0x7ff5980b0a90 2023-08-10T10:29:58.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33426/0 (socket says 172.21.15.161:33426) 2023-08-10T10:29:58.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 -- 172.21.15.161:0/2758503103 learned_addr learned my addr 172.21.15.161:0/2758503103 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:58.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff59cc76700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5981f6220 0x7ff5981f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 0x7ff5980b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 -- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 msgr2=0x7ff5980b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 0x7ff5980b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 -- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5981f6220 msgr2=0x7ff5981f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5981f6220 0x7ff5981f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 -- 172.21.15.161:0/2758503103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5981f3a10 con 0x7ff580003a00 2023-08-10T10:29:58.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 0x7ff5980b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:58.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff597fff700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff58800e4b0 tx=0x7ff5880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800e6c0 con 0x7ff580003a00 2023-08-10T10:29:58.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.002+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588003ab0 con 0x7ff580003a00 2023-08-10T10:29:58.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.003+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588003e60 con 0x7ff580003a00 2023-08-10T10:29:58.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.003+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5981f2c50 con 0x7ff580003a00 2023-08-10T10:29:58.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.003+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5981f3210 con 0x7ff580003a00 2023-08-10T10:29:58.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.003+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5980744e0 con 0x7ff580003a00 2023-08-10T10:29:58.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.004+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff588013470 con 0x7ff580003a00 2023-08-10T10:29:58.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.004+0000 7ff594ff9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 0x7ff58406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.004+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff58808a980 con 0x7ff580003a00 2023-08-10T10:29:58.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.004+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 0x7ff58406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.005+0000 7ff5977fe700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 0x7ff58406d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff58c007fd0 tx=0x7ff58c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.009+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff588055e10 con 0x7ff580003a00 2023-08-10T10:29:58.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.275+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff598161820 con 0x7ff580003a00 2023-08-10T10:29:58.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.279+0000 7ff594ff9700 1 -- 172.21.15.161:0/2758503103 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff5880170a0 con 0x7ff580003a00 2023-08-10T10:29:58.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.281+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 msgr2=0x7ff58406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.281+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 0x7ff58406d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff58c007fd0 tx=0x7ff58c009040 comp rx=0 tx=0).stop 2023-08-10T10:29:58.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.281+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 msgr2=0x7ff5981f2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.281+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff58800e4b0 tx=0x7ff5880047c0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 shutdown_connections 2023-08-10T10:29:58.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff58406ace0 0x7ff58406d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5981f6220 0x7ff5981f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff580003a00 0x7ff5981f2300 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 --2- 172.21.15.161:0/2758503103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5980b0a90 0x7ff5980b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 >> 172.21.15.161:0/2758503103 conn(0x7ff5980cfd70 msgr2=0x7ff5980cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:58.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 shutdown_connections 2023-08-10T10:29:58.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.282+0000 7ff59e6d9700 1 -- 172.21.15.161:0/2758503103 wait complete. 2023-08-10T10:29:58.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-10T10:29:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.415+0000 7f20d5b81700 1 Processor -- start 2023-08-10T10:29:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.416+0000 7f20d5b81700 1 -- start start 2023-08-10T10:29:58.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.416+0000 7f20d5b81700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20d00717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.416+0000 7f20d5b81700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d015b290 con 0x7f20d006e650 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.416+0000 7f20d5b81700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d015b570 con 0x7f20d0071d10 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.416+0000 7f20d5b81700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00c5890 con 0x7f20d0154620 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f20d006e650 0x7f20d015a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38674/0 (socket says 172.21.15.161:38674) 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 -- 172.21.15.161:0/2398859396 learned_addr learned my addr 172.21.15.161:0/2398859396 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119826357 0 0) 0x7f20d015b290 con 0x7f20d006e650 2023-08-10T10:29:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cf7fe700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20d00717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc0057c0 con 0x7f20d006e650 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834339318 0 0) 0x7f20bc0057c0 con 0x7f20d006e650 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 msgr2=0x7f20d00717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20d00717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 >> v1:172.21.15.175:6789/0 conn(0x7f20d0071d10 legacy=0x7f20d006df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0070cf0 con 0x7f20d006e650 2023-08-10T10:29:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f20c80019f0 con 0x7f20d006e650 2023-08-10T10:29:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 >> v1:172.21.15.161:6789/0 conn(0x7f20d006e650 legacy=0x7f20d015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc005c40 0x7f20bc006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20bc006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc006fa0 0x7f20bc007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00c5890 con 0x7f20bc006fa0 2023-08-10T10:29:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc00dcd0 con 0x7f20bc005c40 2023-08-10T10:29:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc00de90 con 0x7f20d0154620 2023-08-10T10:29:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc006fa0 0x7f20bc007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cf7fe700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc005c40 0x7f20bc006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20ceffd700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20bc006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 -- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 msgr2=0x7f20bc006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0154620 0x7f20bc006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 -- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc005c40 msgr2=0x7f20bc006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc005c40 0x7f20bc006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.417+0000 7f20cffff700 1 -- 172.21.15.161:0/2398859396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0057c0 con 0x7f20bc006fa0 2023-08-10T10:29:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20cffff700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc006fa0 0x7f20bc007420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20c800a800 tx=0x7f20bc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243ae68d9d01b5dd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800a2f0 con 0x7f20bc006fa0 2023-08-10T10:29:58.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8012600 con 0x7f20bc006fa0 2023-08-10T10:29:58.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20ce7fc700 1 -- 172.21.15.161:0/2398859396 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80129b0 con 0x7f20bc006fa0 2023-08-10T10:29:58.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 -- 172.21.15.161:0/2398859396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc006fa0 msgr2=0x7f20bc007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 --2- 172.21.15.161:0/2398859396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc006fa0 0x7f20bc007420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20c800a800 tx=0x7f20bc007a90 comp rx=0 tx=0).stop 2023-08-10T10:29:58.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20cffff700 1 -- 172.21.15.161:0/2398859396 reap_dead start 2023-08-10T10:29:58.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 -- 172.21.15.161:0/2398859396 shutdown_connections 2023-08-10T10:29:58.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 -- 172.21.15.161:0/2398859396 >> 172.21.15.161:0/2398859396 conn(0x7f20d00cfd70 msgr2=0x7f20d00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:58.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 -- 172.21.15.161:0/2398859396 shutdown_connections 2023-08-10T10:29:58.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.418+0000 7f20d5b81700 1 -- 172.21.15.161:0/2398859396 wait complete. 2023-08-10T10:29:58.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.420+0000 7f20d5b81700 1 Processor -- start 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.420+0000 7f20d5b81700 1 -- start start 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc006fa0 0x7f20d00b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0151a20 0x7f20d01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0151eb0 con 0x7f20d01ec240 2023-08-10T10:29:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d01578e0 con 0x7f20bc006fa0 2023-08-10T10:29:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20d5b81700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d01efad0 con 0x7f20d0151a20 2023-08-10T10:29:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33446/0 (socket says 172.21.15.161:33446) 2023-08-10T10:29:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 -- 172.21.15.161:0/1177565867 learned_addr learned my addr 172.21.15.161:0/1177565867 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20cffff700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0151a20 0x7f20d01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20cf7fe700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc006fa0 0x7f20d00b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 -- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0151a20 msgr2=0x7f20d01554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0151a20 0x7f20d01554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 -- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc006fa0 msgr2=0x7f20d00b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.421+0000 7f20ceffd700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc006fa0 0x7f20d00b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20ceffd700 1 -- 172.21.15.161:0/1177565867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00b3730 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20ceffd700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f20b800f7f0 tx=0x7f20b800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80052e0 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8005440 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d01eef50 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80038c0 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.422+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01ef510 con 0x7f20d01ec240 2023-08-10T10:29:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.423+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d00744e0 con 0x7f20d01ec240 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.423+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20b8003a20 con 0x7f20d01ec240 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.424+0000 7f20c7fff700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 0x7f20b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.424+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f20b8088ec0 con 0x7f20d01ec240 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.424+0000 7f20cf7fe700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 0x7f20b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.424+0000 7f20cf7fe700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 0x7f20b006d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20d006e550 tx=0x7f20c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.428+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f20b80542c0 con 0x7f20d01ec240 2023-08-10T10:29:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.694+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f20d00b0be0 con 0x7f20d01ec240 2023-08-10T10:29:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.697+0000 7f20c7fff700 1 -- 172.21.15.161:0/1177565867 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f20b80578e0 con 0x7f20d01ec240 2023-08-10T10:29:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 msgr2=0x7f20b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 0x7f20b006d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20d006e550 tx=0x7f20c0008040 comp rx=0 tx=0).stop 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 msgr2=0x7f20d01514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f20b800f7f0 tx=0x7f20b800fbb0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 shutdown_connections 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f20b006ace0 0x7f20b006d1a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d0151a20 0x7f20d01554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20bc006fa0 0x7f20d00b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 --2- 172.21.15.161:0/1177565867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d01ec240 0x7f20d01514e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 >> 172.21.15.161:0/1177565867 conn(0x7f20d00cfd70 msgr2=0x7f20d00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:58.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 shutdown_connections 2023-08-10T10:29:58.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.699+0000 7f20d5b81700 1 -- 172.21.15.161:0/1177565867 wait complete. 2023-08-10T10:29:58.712 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-10T10:29:58.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.833+0000 7f352cbdb700 1 Processor -- start 2023-08-10T10:29:58.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.833+0000 7f352cbdb700 1 -- start start 2023-08-10T10:29:58.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352cbdb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352cbdb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352cbdb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280cf6a0 con 0x7f35280aea70 2023-08-10T10:29:58.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352cbdb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352806eb80 con 0x7f352806a190 2023-08-10T10:29:58.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352cbdb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280af510 con 0x7f3528071940 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f3526d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:60488/0 (socket says 172.21.15.161:60488) 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f3526d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:46860/0 (socket says 172.21.15.161:46860) 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f352659c700 1 -- 172.21.15.161:0/1563463383 learned_addr learned my addr 172.21.15.161:0/1563463383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:58.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f3526d9d700 1 -- 172.21.15.161:0/1563463383 >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 msgr2=0x7f35280c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f3526d9d700 1 --2- 172.21.15.161:0/1563463383 >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.834+0000 7f3526d9d700 1 -- 172.21.15.161:0/1563463383 >> v1:172.21.15.175:6789/0 conn(0x7f35280aea70 legacy=0x7f352806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f3526d9d700 1 -- 172.21.15.161:0/1563463383 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352806ae60 con 0x7f3528071940 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352659c700 1 --2- 172.21.15.161:0/1563463383 >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f3526d9d700 1 --2- 172.21.15.161:0/1563463383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3520009d90 tx=0x7f352000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3348330ec64d87 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352559a700 1 -- 172.21.15.161:0/1563463383 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000e070 con 0x7f3528071940 2023-08-10T10:29:58.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352559a700 1 -- 172.21.15.161:0/1563463383 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000bb20 con 0x7f3528071940 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352559a700 1 -- 172.21.15.161:0/1563463383 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520012430 con 0x7f3528071940 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 -- 172.21.15.161:0/1563463383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 msgr2=0x7f352806a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 --2- 172.21.15.161:0/1563463383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3520009d90 tx=0x7f352000b330 comp rx=0 tx=0).stop 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 -- 172.21.15.161:0/1563463383 shutdown_connections 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 --2- 172.21.15.161:0/1563463383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3528071940 0x7f352806a570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 --2- 172.21.15.161:0/1563463383 >> v2:172.21.15.175:3300/0 conn(0x7f352806a190 0x7f35280c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.835+0000 7f352cbdb700 1 -- 172.21.15.161:0/1563463383 >> 172.21.15.161:0/1563463383 conn(0x7f35280cfd70 msgr2=0x7f35280d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:58.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.836+0000 7f352cbdb700 1 -- 172.21.15.161:0/1563463383 shutdown_connections 2023-08-10T10:29:58.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.836+0000 7f352cbdb700 1 -- 172.21.15.161:0/1563463383 wait complete. 2023-08-10T10:29:58.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.837+0000 7f352cbdb700 1 Processor -- start 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.837+0000 7f352cbdb700 1 -- start start 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3528071940 0x7f3528160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280aea70 0x7f35281614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3528154170 con 0x7f352806a190 2023-08-10T10:29:58.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3528154300 con 0x7f3528071940 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35281439c0 con 0x7f35280aea70 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33460/0 (socket says 172.21.15.161:33460) 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 -- 172.21.15.161:0/4262831644 learned_addr learned my addr 172.21.15.161:0/4262831644 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f3525d9b700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3528071940 0x7f3528160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f3526d9d700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280aea70 0x7f35281614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 -- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280aea70 msgr2=0x7f35281614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280aea70 0x7f35281614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 -- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3528071940 msgr2=0x7f3528160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3528071940 0x7f3528160f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 -- 172.21.15.161:0/4262831644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518009550 con 0x7f352806a190 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352659c700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f351800e9b0 tx=0x7f351800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800ee50 con 0x7f352806a190 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800c850 con 0x7f352806a190 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520009a70 con 0x7f352806a190 2023-08-10T10:29:58.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.838+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800cbc0 con 0x7f352806a190 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.839+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3528143f80 con 0x7f352806a190 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.840+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35280af150 con 0x7f352806a190 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.840+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f351800cd20 con 0x7f352806a190 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.840+0000 7f3516ffd700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 0x7f350806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.840+0000 7f3525d9b700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 0x7f350806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.840+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35180890d0 con 0x7f352806a190 2023-08-10T10:29:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.841+0000 7f3525d9b700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 0x7f350806d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35280713c0 tx=0x7f351c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:58.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:58.845+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f35180544d0 con 0x7f352806a190 2023-08-10T10:29:59.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.113+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f35280744e0 con 0x7f352806a190 2023-08-10T10:29:59.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.116+0000 7f3516ffd700 1 -- 172.21.15.161:0/4262831644 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3518057af0 con 0x7f352806a190 2023-08-10T10:29:59.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 msgr2=0x7f350806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 0x7f350806d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35280713c0 tx=0x7f351c009040 comp rx=0 tx=0).stop 2023-08-10T10:29:59.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 msgr2=0x7f352815dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f351800e9b0 tx=0x7f351800ecc0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 shutdown_connections 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f350806ace0 0x7f350806d1a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280aea70 0x7f35281614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f352806a190 0x7f352815dce0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 --2- 172.21.15.161:0/4262831644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3528071940 0x7f3528160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 >> 172.21.15.161:0/4262831644 conn(0x7f35280cfd70 msgr2=0x7f352806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:59.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 shutdown_connections 2023-08-10T10:29:59.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.118+0000 7f352cbdb700 1 -- 172.21.15.161:0/4262831644 wait complete. 2023-08-10T10:29:59.131 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-10T10:29:59.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.252+0000 7ff6e632b700 1 Processor -- start 2023-08-10T10:29:59.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.252+0000 7ff6e632b700 1 -- start start 2023-08-10T10:29:59.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6e632b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6e006a190 0x7ff6e00c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6e632b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6e632b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00cf6a0 con 0x7ff6e0071940 2023-08-10T10:29:59.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6e632b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e006eb80 con 0x7ff6e006a190 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6e632b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e006ac80 con 0x7ff6e00aea70 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6e006a190 0x7ff6e00c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6e006a190 0x7ff6e00c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33468/0 (socket says 172.21.15.161:33468) 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 -- 172.21.15.161:0/550122800 learned_addr learned my addr 172.21.15.161:0/550122800 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 -- 172.21.15.161:0/550122800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 msgr2=0x7ff6e006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 --2- 172.21.15.161:0/550122800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 -- 172.21.15.161:0/550122800 >> v1:172.21.15.161:6789/0 conn(0x7ff6e0071940 legacy=0x7ff6e006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 -- 172.21.15.161:0/550122800 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e006d260 con 0x7ff6e006a190 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6dffff700 1 --2- 172.21.15.161:0/550122800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e006a190 0x7ff6e00c6810 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40098f0 tx=0x7ff6d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547114fec66febed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6deffd700 1 -- 172.21.15.161:0/550122800 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400b8a0 con 0x7ff6e006a190 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6deffd700 1 -- 172.21.15.161:0/550122800 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400ba00 con 0x7ff6e006a190 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.253+0000 7ff6deffd700 1 -- 172.21.15.161:0/550122800 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400bd90 con 0x7ff6e006a190 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 -- 172.21.15.161:0/550122800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e006a190 msgr2=0x7ff6e00c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 --2- 172.21.15.161:0/550122800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e006a190 0x7ff6e00c6810 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40098f0 tx=0x7ff6d4009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 -- 172.21.15.161:0/550122800 shutdown_connections 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 --2- 172.21.15.161:0/550122800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e006a190 0x7ff6e00c6810 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 --2- 172.21.15.161:0/550122800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 -- 172.21.15.161:0/550122800 >> 172.21.15.161:0/550122800 conn(0x7ff6e00cfd70 msgr2=0x7ff6e00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 -- 172.21.15.161:0/550122800 shutdown_connections 2023-08-10T10:29:59.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.254+0000 7ff6e632b700 1 -- 172.21.15.161:0/550122800 wait complete. 2023-08-10T10:29:59.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.255+0000 7ff6e632b700 1 Processor -- start 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.255+0000 7ff6e632b700 1 -- start start 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 0x7ff6e015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e01f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e01f2920 con 0x7ff6e0071940 2023-08-10T10:29:59.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e01f6f60 con 0x7ff6e006a190 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e632b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0160160 con 0x7ff6e00aea70 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6df7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6df7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33476/0 (socket says 172.21.15.161:33476) 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6df7fe700 1 -- 172.21.15.161:0/1686265383 learned_addr learned my addr 172.21.15.161:0/1686265383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6dffff700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 0x7ff6e015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6e48c8700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e01f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6df7fe700 1 -- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 msgr2=0x7ff6e01f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.256+0000 7ff6df7fe700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e01f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6df7fe700 1 -- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 msgr2=0x7ff6e015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6df7fe700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 0x7ff6e015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6df7fe700 1 -- 172.21.15.161:0/1686265383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009550 con 0x7ff6e0071940 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6dffff700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 0x7ff6e015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6df7fe700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b500 tx=0x7ff6d000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011830 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0011990 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e0160440 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011d40 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.257+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e01579d0 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.258+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0157bf0 con 0x7ff6e0071940 2023-08-10T10:29:59.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.258+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6d001a400 con 0x7ff6e0071940 2023-08-10T10:29:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.259+0000 7ff6dcff9700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 0x7ff6cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.259+0000 7ff6dffff700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 0x7ff6cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.259+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6d0089170 con 0x7ff6e0071940 2023-08-10T10:29:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.259+0000 7ff6dffff700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 0x7ff6cc06d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4014040 tx=0x7ff6d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.263+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff6d0054600 con 0x7ff6e0071940 2023-08-10T10:29:59.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.532+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff6e0160630 con 0x7ff6e0071940 2023-08-10T10:29:59.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.536+0000 7ff6dcff9700 1 -- 172.21.15.161:0/1686265383 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff6d0057c20 con 0x7ff6e0071940 2023-08-10T10:29:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 msgr2=0x7ff6cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 0x7ff6cc06d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4014040 tx=0x7ff6d4008030 comp rx=0 tx=0).stop 2023-08-10T10:29:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 msgr2=0x7ff6e01f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b500 tx=0x7ff6d000b8c0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 shutdown_connections 2023-08-10T10:29:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.538+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff6cc06ace0 0x7ff6cc06d1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6e00aea70 0x7ff6e01f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6e006a190 0x7ff6e015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 --2- 172.21.15.161:0/1686265383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6e0071940 0x7ff6e01f23e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 >> 172.21.15.161:0/1686265383 conn(0x7ff6e00cfd70 msgr2=0x7ff6e015b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 shutdown_connections 2023-08-10T10:29:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.539+0000 7ff6e632b700 1 -- 172.21.15.161:0/1686265383 wait complete. 2023-08-10T10:29:59.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-10T10:29:59.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 Processor -- start 2023-08-10T10:29:59.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 -- start start 2023-08-10T10:29:59.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63b00cb8a0 0x7f63b00ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 0x7f63b006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00ac850 con 0x7f63b01608b0 2023-08-10T10:29:59.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00cef20 con 0x7f63b00cb8a0 2023-08-10T10:29:59.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.672+0000 7f63b6f3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b006a500 con 0x7f63b00ceab0 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63b00cb8a0 0x7f63b00ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63b00cb8a0 0x7f63b00ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33482/0 (socket says 172.21.15.161:33482) 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 -- 172.21.15.161:0/1443817321 learned_addr learned my addr 172.21.15.161:0/1443817321 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 -- 172.21.15.161:0/1443817321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 msgr2=0x7f63b006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63b54d8700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 0x7f63b006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 0x7f63b006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 -- 172.21.15.161:0/1443817321 >> v1:172.21.15.175:6789/0 conn(0x7f63b01608b0 legacy=0x7f63b0160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 -- 172.21.15.161:0/1443817321 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0161630 con 0x7f63b00cb8a0 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63b54d8700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 0x7f63b006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63affff700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00cb8a0 0x7f63b00ce570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f639c0098f0 tx=0x7f639c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc34fde0c545200 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63af7fe700 1 -- 172.21.15.161:0/1443817321 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c004230 con 0x7f63b00cb8a0 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63af7fe700 1 -- 172.21.15.161:0/1443817321 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c004390 con 0x7f63b00cb8a0 2023-08-10T10:29:59.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.673+0000 7f63af7fe700 1 -- 172.21.15.161:0/1443817321 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0036a0 con 0x7f63b00cb8a0 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 -- 172.21.15.161:0/1443817321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00cb8a0 msgr2=0x7f63b00ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00cb8a0 0x7f63b00ce570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f639c0098f0 tx=0x7f639c009c00 comp rx=0 tx=0).stop 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 -- 172.21.15.161:0/1443817321 shutdown_connections 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00ceab0 0x7f63b006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/1443817321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00cb8a0 0x7f63b00ce570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 -- 172.21.15.161:0/1443817321 >> 172.21.15.161:0/1443817321 conn(0x7f63b00cf450 msgr2=0x7f63b00cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 -- 172.21.15.161:0/1443817321 shutdown_connections 2023-08-10T10:29:59.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.674+0000 7f63b6f3b700 1 -- 172.21.15.161:0/1443817321 wait complete. 2023-08-10T10:29:59.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.675+0000 7f63b6f3b700 1 Processor -- start 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.675+0000 7f63b6f3b700 1 -- start start 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00cb8a0 0x7f63b01f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b01608b0 0x7f63b00c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c2f80 con 0x7f63b00ceab0 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01f3870 con 0x7f63b01608b0 2023-08-10T10:29:59.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.676+0000 7f63b6f3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c31d0 con 0x7f63b00cb8a0 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33488/0 (socket says 172.21.15.161:33488) 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 -- 172.21.15.161:0/3154484893 learned_addr learned my addr 172.21.15.161:0/3154484893 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63b54d8700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b01608b0 0x7f63b00c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63b4cd7700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00cb8a0 0x7f63b01f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 -- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00cb8a0 msgr2=0x7f63b01f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00cb8a0 0x7f63b01f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 -- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b01608b0 msgr2=0x7f63b00c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b01608b0 0x7f63b00c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 -- 172.21.15.161:0/3154484893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009550 con 0x7f63b00ceab0 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63affff700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f639c009130 tx=0x7f639c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c003cd0 con 0x7f63b00ceab0 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c01f070 con 0x7f63b00ceab0 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b00c34b0 con 0x7f63b00ceab0 2023-08-10T10:29:59.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00b8a0 con 0x7f63b00ceab0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.677+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b00c3a70 con 0x7f63b00ceab0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.678+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b00744e0 con 0x7f63b00ceab0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.679+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f639c021030 con 0x7f63b00ceab0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.679+0000 7f63ad7fa700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 0x7f639406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.679+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f639c08a640 con 0x7f63b00ceab0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.679+0000 7f63b4cd7700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 0x7f639406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:29:59.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.679+0000 7f63b4cd7700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 0x7f639406d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009960 tx=0x7f63a40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:29:59.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.683+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f639c055ad0 con 0x7f63b00ceab0 2023-08-10T10:29:59.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.948+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f63b0161bc0 con 0x7f63b00ceab0 2023-08-10T10:29:59.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.952+0000 7f63ad7fa700 1 -- 172.21.15.161:0/3154484893 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f639c0590f0 con 0x7f63b00ceab0 2023-08-10T10:29:59.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 msgr2=0x7f639406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 0x7f639406d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009960 tx=0x7f63a40090e0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 msgr2=0x7f63b00c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f639c009130 tx=0x7f639c004750 comp rx=0 tx=0).stop 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 shutdown_connections 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f639406ace0 0x7f639406d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b01608b0 0x7f63b00c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63b00cb8a0 0x7f63b01f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 --2- 172.21.15.161:0/3154484893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63b00ceab0 0x7f63b00c56e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:29:59.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 >> 172.21.15.161:0/3154484893 conn(0x7f63b00cf450 msgr2=0x7f63b00ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:29:59.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 shutdown_connections 2023-08-10T10:29:59.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:29:59.954+0000 7f63b6f3b700 1 -- 172.21.15.161:0/3154484893 wait complete. 2023-08-10T10:29:59.968 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:00.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.088+0000 7f00073a1700 1 Processor -- start 2023-08-10T10:30:00.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 -- start start 2023-08-10T10:30:00.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00000c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0000071940 0x7f000006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000cf6a0 con 0x7f000006a190 2023-08-10T10:30:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000006eb80 con 0x7f0000071940 2023-08-10T10:30:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.089+0000 7f00073a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000af510 con 0x7f00000aea70 2023-08-10T10:30:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000513d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f000006a190 0x7f000006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38732/0 (socket says 172.21.15.161:38732) 2023-08-10T10:30:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000513d700 1 -- 172.21.15.161:0/3890406611 learned_addr learned my addr 172.21.15.161:0/3890406611 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 --2- 172.21.15.161:0/3890406611 >> v2:172.21.15.161:3300/0 conn(0x7f0000071940 0x7f000006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000493c700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00000c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 -- 172.21.15.161:0/3890406611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 msgr2=0x7f00000c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00000c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 -- 172.21.15.161:0/3890406611 >> v1:172.21.15.161:6789/0 conn(0x7f000006a190 legacy=0x7f000006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 -- 172.21.15.161:0/3890406611 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000006ae60 con 0x7f0000071940 2023-08-10T10:30:00.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7f000593e700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000006a570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efff8009d90 tx=0x7efff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cfc8cdd5d4f3d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7efff7fff700 1 -- 172.21.15.161:0/3890406611 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800e070 con 0x7f0000071940 2023-08-10T10:30:00.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7efff7fff700 1 -- 172.21.15.161:0/3890406611 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800bb20 con 0x7f0000071940 2023-08-10T10:30:00.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.090+0000 7efff7fff700 1 -- 172.21.15.161:0/3890406611 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8012430 con 0x7f0000071940 2023-08-10T10:30:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 -- 172.21.15.161:0/3890406611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 msgr2=0x7f000006a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000006a570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efff8009d90 tx=0x7efff800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 -- 172.21.15.161:0/3890406611 shutdown_connections 2023-08-10T10:30:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000006a570 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 --2- 172.21.15.161:0/3890406611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00000c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 -- 172.21.15.161:0/3890406611 >> 172.21.15.161:0/3890406611 conn(0x7f00000cfd70 msgr2=0x7f00000d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 -- 172.21.15.161:0/3890406611 shutdown_connections 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.091+0000 7f00073a1700 1 -- 172.21.15.161:0/3890406611 wait complete. 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.092+0000 7f00073a1700 1 Processor -- start 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.092+0000 7f00073a1700 1 -- start start 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000006a190 0x7f0000154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00001f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000015dd30 con 0x7f0000071940 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000155350 con 0x7f000006a190 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000015fdb0 con 0x7f00000aea70 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33502/0 (socket says 172.21.15.161:33502) 2023-08-10T10:30:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 -- 172.21.15.161:0/993605810 learned_addr learned my addr 172.21.15.161:0/993605810 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000593e700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00001f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000513d700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000006a190 0x7f0000154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 -- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 msgr2=0x7f00001f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00001f00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 -- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000006a190 msgr2=0x7f0000154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000006a190 0x7f0000154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 -- 172.21.15.161:0/993605810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009a70 con 0x7f0000071940 2023-08-10T10:30:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f000493c700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e980 tx=0x7efffc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc009710 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00c850 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0000160090 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.093+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00cc00 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.094+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00001f0600 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.095+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00000af150 con 0x7f0000071940 2023-08-10T10:30:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.095+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efffc013470 con 0x7f0000071940 2023-08-10T10:30:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.095+0000 7efff5ffb700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 0x7effe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.095+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efffc0892b0 con 0x7f0000071940 2023-08-10T10:30:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.096+0000 7f000513d700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 0x7effe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.096+0000 7f000513d700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 0x7effe406d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efff0005910 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.100+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efffc058200 con 0x7f0000071940 2023-08-10T10:30:00.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.288+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00000744e0 con 0x7f0000071940 2023-08-10T10:30:00.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.289+0000 7efff5ffb700 1 -- 172.21.15.161:0/993605810 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14639 (secure 0 0 0) 0x7efffc057d90 con 0x7f0000071940 2023-08-10T10:30:00.291 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:00.291 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":33,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:29:57.021503+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 msgr2=0x7effe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 0x7effe406d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efff0005910 tx=0x7efff0009040 comp rx=0 tx=0).stop 2023-08-10T10:30:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 msgr2=0x7f000015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e980 tx=0x7efffc00ed40 comp rx=0 tx=0).stop 2023-08-10T10:30:00.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 shutdown_connections 2023-08-10T10:30:00.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7effe406ace0 0x7effe406d1a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00000aea70 0x7f00001f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000006a190 0x7f0000154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 --2- 172.21.15.161:0/993605810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0000071940 0x7f000015d7f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 >> 172.21.15.161:0/993605810 conn(0x7f00000cfd70 msgr2=0x7f000015ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 shutdown_connections 2023-08-10T10:30:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.291+0000 7f00073a1700 1 -- 172.21.15.161:0/993605810 wait complete. 2023-08-10T10:30:00.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:28:52.227869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:28:57.135292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:30:00.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:30:00.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.431+0000 7fa3f8adb700 1 Processor -- start 2023-08-10T10:30:00.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.431+0000 7fa3f8adb700 1 -- start start 2023-08-10T10:30:00.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f8adb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3f40d0ed0 0x7fa3f40d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f8adb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40cddf0 con 0x7fa3f40d1d30 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f8adb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40ce090 con 0x7fa3f41609d0 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f8adb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40b22f0 con 0x7fa3f40d0ed0 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f1d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa3f40d1d30 0x7fa3f40afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38746/0 (socket says 172.21.15.161:38746) 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f1d9b700 1 -- 172.21.15.161:0/4112569446 learned_addr learned my addr 172.21.15.161:0/4112569446 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980276663 0 0) 0x7fa3f40cddf0 con 0x7fa3f40d1d30 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc0035b0 con 0x7fa3f40d1d30 2023-08-10T10:30:00.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f2d9d700 1 --2- 172.21.15.161:0/4112569446 >> v2:172.21.15.175:3300/0 conn(0x7fa3f40d0ed0 0x7fa3f40d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323119971 0 0) 0x7fa3dc0035b0 con 0x7fa3f40d1d30 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 >> v2:172.21.15.175:3300/0 conn(0x7fa3f40d0ed0 msgr2=0x7fa3f40d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 --2- 172.21.15.161:0/4112569446 >> v2:172.21.15.175:3300/0 conn(0x7fa3f40d0ed0 0x7fa3f40d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 >> v1:172.21.15.175:6789/0 conn(0x7fa3f41609d0 legacy=0x7fa3f40d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40ce370 con 0x7fa3f40d1d30 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fa3e8001670 con 0x7fa3f40d1d30 2023-08-10T10:30:00.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 >> v1:172.21.15.161:6789/0 conn(0x7fa3f40d1d30 legacy=0x7fa3f40afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3dc004850 0x7fa3dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.432+0000 7fa3f159a700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3dc005210 0x7fa3dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40b22f0 con 0x7fa3dc003a00 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc00c0b0 con 0x7fa3dc004850 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc00c270 con 0x7fa3dc005210 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f1d9b700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3dc004850 0x7fa3dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f2d9d700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3dc005210 0x7fa3dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 -- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3dc005210 msgr2=0x7fa3dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3dc005210 0x7fa3dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 -- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3dc004850 msgr2=0x7fa3dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3dc004850 0x7fa3dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 -- 172.21.15.161:0/4112569446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0035b0 con 0x7fa3dc003a00 2023-08-10T10:30:00.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f2d9d700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3dc005210 0x7fa3dc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:00.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f2d9d700 1 -- 172.21.15.161:0/4112569446 reap_dead start 2023-08-10T10:30:00.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f259c700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3dc003e20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40017c0 tx=0x7fa3dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bef0206c151f72 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40052d0 con 0x7fa3dc003a00 2023-08-10T10:30:00.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e4005430 con 0x7fa3dc003a00 2023-08-10T10:30:00.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.433+0000 7fa3f159a700 1 -- 172.21.15.161:0/4112569446 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40038c0 con 0x7fa3dc003a00 2023-08-10T10:30:00.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 -- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 msgr2=0x7fa3dc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3dc003e20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40017c0 tx=0x7fa3dc005880 comp rx=0 tx=0).stop 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 -- 172.21.15.161:0/4112569446 shutdown_connections 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/4112569446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3dc003e20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 -- 172.21.15.161:0/4112569446 >> 172.21.15.161:0/4112569446 conn(0x7fa3f40d3040 msgr2=0x7fa3f40d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 -- 172.21.15.161:0/4112569446 shutdown_connections 2023-08-10T10:30:00.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.434+0000 7fa3f8adb700 1 -- 172.21.15.161:0/4112569446 wait complete. 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.435+0000 7fa3f8adb700 1 Processor -- start 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.435+0000 7fa3f8adb700 1 -- start start 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f40b3b70 0x7fa3f414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f40b4960 0x7fa3f40b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40b2e40 con 0x7fa3dc003a00 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40b36e0 con 0x7fa3f40b3b70 2023-08-10T10:30:00.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f8adb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40b4e60 con 0x7fa3f40b4960 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33518/0 (socket says 172.21.15.161:33518) 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 -- 172.21.15.161:0/2586846249 learned_addr learned my addr 172.21.15.161:0/2586846249 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f2d9d700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f40b4960 0x7fa3f40b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f1d9b700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f40b3b70 0x7fa3f414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 -- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f40b4960 msgr2=0x7fa3f40b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f40b4960 0x7fa3f40b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 -- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f40b3b70 msgr2=0x7fa3f414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f40b3b70 0x7fa3f414c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.436+0000 7fa3f259c700 1 -- 172.21.15.161:0/2586846249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40b3090 con 0x7fa3dc003a00 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3f259c700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4015040 tx=0x7fa3e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4001290 con 0x7fa3dc003a00 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e401d480 con 0x7fa3dc003a00 2023-08-10T10:30:00.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f40b3370 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e401d810 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.437+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f40b80a0 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.438+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f40b3500 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.438+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3e4019040 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.439+0000 7fa3e2ffd700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 0x7fa3d406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.439+0000 7fa3f1d9b700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 0x7fa3d406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.439+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3e4089d40 con 0x7fa3dc003a00 2023-08-10T10:30:00.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.439+0000 7fa3f1d9b700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 0x7fa3d406d1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000c00 tx=0x7fa3e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.443+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3e4055130 con 0x7fa3dc003a00 2023-08-10T10:30:00.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.630+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3f404ecc0 con 0x7fa3dc003a00 2023-08-10T10:30:00.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.631+0000 7fa3e2ffd700 1 -- 172.21.15.161:0/2586846249 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3e4058750 con 0x7fa3dc003a00 2023-08-10T10:30:00.632 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-08-10T10:30:00.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 msgr2=0x7fa3d406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 0x7fa3d406d1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000c00 tx=0x7fa3e8009040 comp rx=0 tx=0).stop 2023-08-10T10:30:00.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 msgr2=0x7fa3f4156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4015040 tx=0x7fa3e4001120 comp rx=0 tx=0).stop 2023-08-10T10:30:00.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 shutdown_connections 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa3d406ad10 0x7fa3d406d1d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f40b4960 0x7fa3f40b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3dc003a00 0x7fa3f4156840 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 --2- 172.21.15.161:0/2586846249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f40b3b70 0x7fa3f414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 >> 172.21.15.161:0/2586846249 conn(0x7fa3f40d3040 msgr2=0x7fa3f40b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 shutdown_connections 2023-08-10T10:30:00.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.633+0000 7fa3f8adb700 1 -- 172.21.15.161:0/2586846249 wait complete. 2023-08-10T10:30:00.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:30:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.768+0000 7ff3a7aee700 1 Processor -- start 2023-08-10T10:30:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.769+0000 7ff3a7aee700 1 -- start start 2023-08-10T10:30:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a7aee700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3a015ac10 0x7ff3a00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a7aee700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00cebe0 con 0x7ff3a015aff0 2023-08-10T10:30:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a7aee700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a0071620 con 0x7ff3a00b1740 2023-08-10T10:30:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a7aee700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a00b25a0 con 0x7ff3a015ac10 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3a015ac10 0x7ff3a00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3a015ac10 0x7ff3a00710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33526/0 (socket says 172.21.15.161:33526) 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 -- 172.21.15.161:0/204465007 learned_addr learned my addr 172.21.15.161:0/204465007 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a5089700 1 --1- 172.21.15.161:0/204465007 >> v1:172.21.15.161:6789/0 conn(0x7ff3a015aff0 0x7ff3a00b2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38764/0 (socket says 172.21.15.161:38764) 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 -- 172.21.15.161:0/204465007 >> v1:172.21.15.175:6789/0 conn(0x7ff3a00b1740 legacy=0x7ff3a00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 -- 172.21.15.161:0/204465007 >> v1:172.21.15.161:6789/0 conn(0x7ff3a015aff0 legacy=0x7ff3a00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 -- 172.21.15.161:0/204465007 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00b1d00 con 0x7ff3a015ac10 2023-08-10T10:30:00.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a588a700 1 --2- 172.21.15.161:0/204465007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015ac10 0x7ff3a00710e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098f0 tx=0x7ff390009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21683ae1fe45e17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a4888700 1 -- 172.21.15.161:0/204465007 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390004230 con 0x7ff3a015ac10 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a4888700 1 -- 172.21.15.161:0/204465007 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390004390 con 0x7ff3a015ac10 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.770+0000 7ff3a4888700 1 -- 172.21.15.161:0/204465007 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3900036a0 con 0x7ff3a015ac10 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 -- 172.21.15.161:0/204465007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015ac10 msgr2=0x7ff3a00710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/204465007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015ac10 0x7ff3a00710e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098f0 tx=0x7ff390009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 -- 172.21.15.161:0/204465007 shutdown_connections 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/204465007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015ac10 0x7ff3a00710e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 -- 172.21.15.161:0/204465007 >> 172.21.15.161:0/204465007 conn(0x7ff3a00cc740 msgr2=0x7ff3a00ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 -- 172.21.15.161:0/204465007 shutdown_connections 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.771+0000 7ff3a7aee700 1 -- 172.21.15.161:0/204465007 wait complete. 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.772+0000 7ff3a7aee700 1 Processor -- start 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.772+0000 7ff3a7aee700 1 -- start start 2023-08-10T10:30:00.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a00b1740 0x7ff3a00c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3a015ac10 0x7ff3a00c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00c3990 con 0x7ff3a015aff0 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015c990 con 0x7ff3a00b1740 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a7aee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015d4b0 con 0x7ff3a015ac10 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33534/0 (socket says 172.21.15.161:33534) 2023-08-10T10:30:00.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 -- 172.21.15.161:0/2993769610 learned_addr learned my addr 172.21.15.161:0/2993769610 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a588a700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a00b1740 0x7ff3a00c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a5089700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3a015ac10 0x7ff3a00c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 -- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3a015ac10 msgr2=0x7ff3a00c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3a015ac10 0x7ff3a00c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 -- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a00b1740 msgr2=0x7ff3a00c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a00b1740 0x7ff3a00c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 -- 172.21.15.161:0/2993769610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009550 con 0x7ff3a015aff0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.773+0000 7ff3a608b700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff39800cc40 tx=0x7ff39800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.774+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800aba0 con 0x7ff3a015aff0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.774+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800ad00 con 0x7ff3a015aff0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.774+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398012660 con 0x7ff3a015aff0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.774+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a015cc10 con 0x7ff3a015aff0 2023-08-10T10:30:00.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.774+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a015d1d0 con 0x7ff3a015aff0 2023-08-10T10:30:00.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.775+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a00c3ad0 con 0x7ff3a015aff0 2023-08-10T10:30:00.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.775+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3980127c0 con 0x7ff3a015aff0 2023-08-10T10:30:00.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.775+0000 7ff3967fc700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 0x7ff38406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:00.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.776+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff398089a30 con 0x7ff3a015aff0 2023-08-10T10:30:00.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.776+0000 7ff3a588a700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 0x7ff38406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:00.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.776+0000 7ff3a588a700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 0x7ff38406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff390009130 tx=0x7ff390008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:00.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.780+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff3a00c3ad0 con 0x7ff3a015aff0 2023-08-10T10:30:00.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.967+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3a00c3ad0 con 0x7ff3a015aff0 2023-08-10T10:30:00.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.968+0000 7ff3967fc700 1 -- 172.21.15.161:0/2993769610 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3a00c3ad0 con 0x7ff3a015aff0 2023-08-10T10:30:00.969 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2023-08-10T10:30:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 msgr2=0x7ff38406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 0x7ff38406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff390009130 tx=0x7ff390008030 comp rx=0 tx=0).stop 2023-08-10T10:30:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 msgr2=0x7ff3a015c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff39800cc40 tx=0x7ff39800a060 comp rx=0 tx=0).stop 2023-08-10T10:30:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 shutdown_connections 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7ff38406ace0 0x7ff38406d1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a015aff0 0x7ff3a015c450 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a00b1740 0x7ff3a00c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 --2- 172.21.15.161:0/2993769610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3a015ac10 0x7ff3a00c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 >> 172.21.15.161:0/2993769610 conn(0x7ff3a00cc740 msgr2=0x7ff3a01598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:00.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 shutdown_connections 2023-08-10T10:30:00.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:00.970+0000 7ff3a7aee700 1 -- 172.21.15.161:0/2993769610 wait complete. 2023-08-10T10:30:00.983 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:30:01.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.103+0000 7f9614fff700 1 Processor -- start 2023-08-10T10:30:01.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.103+0000 7f9614fff700 1 -- start start 2023-08-10T10:30:01.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f961006a190 0x7f96100c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96100aea70 0x7f961006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9610071940 0x7f961006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961006eb80 con 0x7f96100aea70 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100af510 con 0x7f9610071940 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.104+0000 7f9614fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961006b140 con 0x7f961006a190 2023-08-10T10:30:01.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96100aea70 0x7f961006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96100aea70 0x7f961006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33540/0 (socket says 172.21.15.161:33540) 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 -- 172.21.15.161:0/389939524 learned_addr learned my addr 172.21.15.161:0/389939524 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960ed9d700 1 --2- 172.21.15.161:0/389939524 >> v2:172.21.15.175:3300/0 conn(0x7f9610071940 0x7f961006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 -- 172.21.15.161:0/389939524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f961006a190 msgr2=0x7f96100c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960e59c700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f961006a190 0x7f96100c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f961006a190 0x7f96100c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 -- 172.21.15.161:0/389939524 >> v2:172.21.15.175:3300/0 conn(0x7f9610071940 msgr2=0x7f961006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 --2- 172.21.15.161:0/389939524 >> v2:172.21.15.175:3300/0 conn(0x7f9610071940 0x7f961006a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 -- 172.21.15.161:0/389939524 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100cf6a0 con 0x7f96100aea70 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960dd9b700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96100aea70 0x7f961006cd20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9610161df0 tx=0x7f9600009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dae7c71fe22d9e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960d59a700 1 -- 172.21.15.161:0/389939524 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000b870 con 0x7f96100aea70 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960d59a700 1 -- 172.21.15.161:0/389939524 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000b9d0 con 0x7f96100aea70 2023-08-10T10:30:01.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.105+0000 7f960d59a700 1 -- 172.21.15.161:0/389939524 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000bd60 con 0x7f96100aea70 2023-08-10T10:30:01.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 -- 172.21.15.161:0/389939524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96100aea70 msgr2=0x7f961006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96100aea70 0x7f961006cd20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9610161df0 tx=0x7f9600009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 -- 172.21.15.161:0/389939524 shutdown_connections 2023-08-10T10:30:01.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 --2- 172.21.15.161:0/389939524 >> v2:172.21.15.175:3300/0 conn(0x7f9610071940 0x7f961006a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f961006a190 0x7f96100c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 --2- 172.21.15.161:0/389939524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96100aea70 0x7f961006cd20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 -- 172.21.15.161:0/389939524 >> 172.21.15.161:0/389939524 conn(0x7f96100cfd70 msgr2=0x7f96100d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:01.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 -- 172.21.15.161:0/389939524 shutdown_connections 2023-08-10T10:30:01.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.106+0000 7f9614fff700 1 -- 172.21.15.161:0/389939524 wait complete. 2023-08-10T10:30:01.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.107+0000 7f9614fff700 1 Processor -- start 2023-08-10T10:30:01.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.107+0000 7f9614fff700 1 -- start start 2023-08-10T10:30:01.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610071940 0x7f96100b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96100aea70 0x7f96101f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100b6020 con 0x7f961006a190 2023-08-10T10:30:01.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96101f72b0 con 0x7f9610071940 2023-08-10T10:30:01.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f9614fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100b54a0 con 0x7f96100aea70 2023-08-10T10:30:01.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33544/0 (socket says 172.21.15.161:33544) 2023-08-10T10:30:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 -- 172.21.15.161:0/2341022145 learned_addr learned my addr 172.21.15.161:0/2341022145 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960ed9d700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96100aea70 0x7f96101f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960dd9b700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610071940 0x7f96100b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 -- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96100aea70 msgr2=0x7f96101f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96100aea70 0x7f96101f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 -- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610071940 msgr2=0x7f96100b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610071940 0x7f96100b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.108+0000 7f960e59c700 1 -- 172.21.15.161:0/2341022145 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009550 con 0x7f961006a190 2023-08-10T10:30:01.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f960e59c700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f960400c7f0 tx=0x7f960400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011800 con 0x7f961006a190 2023-08-10T10:30:01.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604011960 con 0x7f961006a190 2023-08-10T10:30:01.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011cf0 con 0x7f961006a190 2023-08-10T10:30:01.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96100b5780 con 0x7f961006a190 2023-08-10T10:30:01.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.109+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100b5d40 con 0x7f961006a190 2023-08-10T10:30:01.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.110+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100744e0 con 0x7f961006a190 2023-08-10T10:30:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.110+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9604018360 con 0x7f961006a190 2023-08-10T10:30:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.111+0000 7f95feffd700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 0x7f95f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.111+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9604088ec0 con 0x7f961006a190 2023-08-10T10:30:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.111+0000 7f960dd9b700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 0x7f95f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.111+0000 7f960dd9b700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 0x7f95f006d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96100aeeb0 tx=0x7f9600008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.115+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f96040542c0 con 0x7f961006a190 2023-08-10T10:30:01.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.305+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f961015c630 con 0x7f961006a190 2023-08-10T10:30:01.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.306+0000 7f95feffd700 1 -- 172.21.15.161:0/2341022145 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f960401f090 con 0x7f961006a190 2023-08-10T10:30:01.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-08-10T10:30:01.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-08-10T10:30:01.309 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 2, 2023-08-10T10:30:01.309 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": "rbd" 2023-08-10T10:30:01.309 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-08-10T10:30:01.309 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-08-10T10:30:01.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 msgr2=0x7f95f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 0x7f95f006d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96100aeeb0 tx=0x7f9600008030 comp rx=0 tx=0).stop 2023-08-10T10:30:01.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 msgr2=0x7f961014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f960400c7f0 tx=0x7f960400cb00 comp rx=0 tx=0).stop 2023-08-10T10:30:01.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 shutdown_connections 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f95f006ace0 0x7f95f006d1a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96100aea70 0x7f96101f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f961006a190 0x7f961014d7e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 --2- 172.21.15.161:0/2341022145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610071940 0x7f96100b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 >> 172.21.15.161:0/2341022145 conn(0x7f96100cfd70 msgr2=0x7f9610161390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 shutdown_connections 2023-08-10T10:30:01.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.308+0000 7f9614fff700 1 -- 172.21.15.161:0/2341022145 wait complete. 2023-08-10T10:30:01.321 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:30:01.321 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:30:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.445+0000 7fa2b6ad5700 1 Processor -- start 2023-08-10T10:30:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.445+0000 7fa2b6ad5700 1 -- start start 2023-08-10T10:30:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b6ad5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2b00d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b6ad5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2b00d1a40 0x7fa2b00cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b6ad5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b00ce170 con 0x7fa2b00cdd20 2023-08-10T10:30:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b6ad5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00ccd40 con 0x7fa2b00d1a40 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b6ad5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00cc780 con 0x7fa2b015b050 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b5072700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa2b00cdd20 0x7fa2b00ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38794/0 (socket says 172.21.15.161:38794) 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b5072700 1 -- 172.21.15.161:0/2125634010 learned_addr learned my addr 172.21.15.161:0/2125634010 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2affff700 1 --2- 172.21.15.161:0/2125634010 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00d1a40 0x7fa2b00cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244010509 0 0) 0x7fa2a8001490 con 0x7fa2b00cdd20 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a00035b0 con 0x7fa2b00cdd20 2023-08-10T10:30:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2b4871700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2b00d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960786603 0 0) 0x7fa2a00035b0 con 0x7fa2b00cdd20 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 msgr2=0x7fa2b00d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2b00d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00d1a40 msgr2=0x7fa2b00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 --2- 172.21.15.161:0/2125634010 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00d1a40 0x7fa2b00cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00cca60 con 0x7fa2b00cdd20 2023-08-10T10:30:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fa2a8001b80 con 0x7fa2b00cdd20 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 >> v1:172.21.15.161:6789/0 conn(0x7fa2b00cdd20 legacy=0x7fa2b00ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0003a00 0x7fa2a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a0004d90 0x7fa2a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00ccd40 con 0x7fa2a0004d90 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00cc780 con 0x7fa2a0003a00 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.446+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a000ba10 con 0x7fa2b015b050 2023-08-10T10:30:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a0004d90 0x7fa2a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b4871700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0003a00 0x7fa2a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2affff700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 -- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 msgr2=0x7fa2a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b015b050 0x7fa2a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 -- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0003a00 msgr2=0x7fa2a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0003a00 0x7fa2a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 -- 172.21.15.161:0/2125634010 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00035b0 con 0x7fa2a0004d90 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2b5072700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a0004d90 0x7fa2a0005210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800a830 tx=0x7fa2a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82f600dfbdbb82a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800a4c0 con 0x7fa2a0004d90 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a8012600 con 0x7fa2a0004d90 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.447+0000 7fa2af7fe700 1 -- 172.21.15.161:0/2125634010 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80129b0 con 0x7fa2a0004d90 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/2125634010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a0004d90 msgr2=0x7fa2a0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/2125634010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a0004d90 0x7fa2a0005210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800a830 tx=0x7fa2a0005880 comp rx=0 tx=0).stop 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b5072700 1 -- 172.21.15.161:0/2125634010 reap_dead start 2023-08-10T10:30:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/2125634010 shutdown_connections 2023-08-10T10:30:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/2125634010 >> 172.21.15.161:0/2125634010 conn(0x7fa2b009a150 msgr2=0x7fa2b00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/2125634010 shutdown_connections 2023-08-10T10:30:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.448+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/2125634010 wait complete. 2023-08-10T10:30:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.449+0000 7fa2b6ad5700 1 Processor -- start 2023-08-10T10:30:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.449+0000 7fa2b6ad5700 1 -- start start 2023-08-10T10:30:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b006c720 0x7fa2b0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b00b1e50 0x7fa2b0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0152880 con 0x7fa2b00b5f70 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b006b680 con 0x7fa2b00b1e50 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b6ad5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b006b960 con 0x7fa2b006c720 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33564/0 (socket says 172.21.15.161:33564) 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 -- 172.21.15.161:0/3041472446 learned_addr learned my addr 172.21.15.161:0/3041472446 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2affff700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b006c720 0x7fa2b0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b5072700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b00b1e50 0x7fa2b0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 -- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b006c720 msgr2=0x7fa2b0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b006c720 0x7fa2b0151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 -- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b00b1e50 msgr2=0x7fa2b0152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b00b1e50 0x7fa2b0152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 -- 172.21.15.161:0/3041472446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b006bc40 con 0x7fa2b00b5f70 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2b4871700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009fd0 tx=0x7fa2a4011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.450+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4005a20 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.451+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a4005b80 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.451+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b006bf20 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.451+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400f730 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.451+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b006b2a0 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.452+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b00744e0 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.452+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2a400f890 con 0x7fa2b00b5f70 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.452+0000 7fa2ad7fa700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 0x7fa29406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.452+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa2a4089710 con 0x7fa2b00b5f70 2023-08-10T10:30:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.452+0000 7fa2affff700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 0x7fa29406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.453+0000 7fa2affff700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 0x7fa29406d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00b4950 tx=0x7fa29c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.457+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa2a4054b10 con 0x7fa2b00b5f70 2023-08-10T10:30:01.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:01.647+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa2b00c7120 con 0x7fa2b00b5f70 2023-08-10T10:30:02.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.036+0000 7fa2ad7fa700 1 -- 172.21.15.161:0/3041472446 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2a4058130 con 0x7fa2b00b5f70 2023-08-10T10:30:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.040+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 msgr2=0x7fa29406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.040+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 0x7fa29406d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00b4950 tx=0x7fa29c009210 comp rx=0 tx=0).stop 2023-08-10T10:30:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.040+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 msgr2=0x7fa2b00b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.040+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009fd0 tx=0x7fa2a4011c80 comp rx=0 tx=0).stop 2023-08-10T10:30:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 shutdown_connections 2023-08-10T10:30:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fa29406ace0 0x7fa29406d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b00b1e50 0x7fa2b0152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b00b5f70 0x7fa2b00b4410 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 --2- 172.21.15.161:0/3041472446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b006c720 0x7fa2b0151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.041+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 >> 172.21.15.161:0/3041472446 conn(0x7fa2b009a150 msgr2=0x7fa2b00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:02.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.042+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 shutdown_connections 2023-08-10T10:30:02.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.042+0000 7fa2b6ad5700 1 -- 172.21.15.161:0/3041472446 wait complete. 2023-08-10T10:30:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-08-10T10:30:02.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:30:02.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.182+0000 7f6dc1473700 1 Processor -- start 2023-08-10T10:30:02.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.182+0000 7f6dc1473700 1 -- start start 2023-08-10T10:30:02.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dc1473700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6dbc0d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dc1473700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0d0440 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dc1473700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0cb5d0 con 0x7f6dbc06b560 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dc1473700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0cb8b0 con 0x7f6dbc06bcb0 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dba7fc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6dbc0b3c30 0x7f6dbc06c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38812/0 (socket says 172.21.15.161:38812) 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.183+0000 7f6dba7fc700 1 -- 172.21.15.161:0/320568422 learned_addr learned my addr 172.21.15.161:0/320568422 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6dbc0d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538813924 0 0) 0x7f6dbc0d0440 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da40035b0 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772882651 0 0) 0x7f6da40035b0 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 msgr2=0x7f6dbc0d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6dbc0d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 >> v1:172.21.15.175:6789/0 conn(0x7f6dbc06b560 legacy=0x7f6dbc0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0cbb90 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f6dac001670 con 0x7f6dbc0b3c30 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 >> v1:172.21.15.161:6789/0 conn(0x7f6dbc0b3c30 legacy=0x7f6dbc06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6da4003a30 0x7f6da4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6da4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4004d90 0x7f6da4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0cb8b0 con 0x7f6da4003a30 2023-08-10T10:30:02.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400bac0 con 0x7f6da4004d90 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400bc80 con 0x7f6dbc06bcb0 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6da4003a30 0x7f6da4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dba7fc700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6da4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbb7fe700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4004d90 0x7f6da4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 -- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 msgr2=0x7f6da4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dbc06bcb0 0x7f6da4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 -- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4004d90 msgr2=0x7f6da4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4004d90 0x7f6da4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.184+0000 7f6dbaffd700 1 -- 172.21.15.161:0/320568422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40035b0 con 0x7f6da4003a30 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6da4003a30 0x7f6da4003e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009b30 tx=0x7f6da4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07a2b10875dad13 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000e6c0 con 0x7f6da4003a30 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000e820 con 0x7f6da4003a30 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6db9ffb700 1 -- 172.21.15.161:0/320568422 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000eb90 con 0x7f6da4003a30 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 -- 172.21.15.161:0/320568422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6da4003a30 msgr2=0x7f6da4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 --2- 172.21.15.161:0/320568422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6da4003a30 0x7f6da4003e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009b30 tx=0x7f6da4005880 comp rx=0 tx=0).stop 2023-08-10T10:30:02.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dbb7fe700 1 -- 172.21.15.161:0/320568422 reap_dead start 2023-08-10T10:30:02.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 -- 172.21.15.161:0/320568422 shutdown_connections 2023-08-10T10:30:02.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 -- 172.21.15.161:0/320568422 >> 172.21.15.161:0/320568422 conn(0x7f6dbc09a140 msgr2=0x7f6dbc0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:02.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 -- 172.21.15.161:0/320568422 shutdown_connections 2023-08-10T10:30:02.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.185+0000 7f6dc1473700 1 -- 172.21.15.161:0/320568422 wait complete. 2023-08-10T10:30:02.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 Processor -- start 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 -- start start 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da4003a30 0x7f6dbc14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dbc15e940 0x7f6dbc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc14e820 con 0x7f6dbc0b1660 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0b08a0 con 0x7f6dbc15e940 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.187+0000 7f6dc1473700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0b0b80 con 0x7f6da4003a30 2023-08-10T10:30:02.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33586/0 (socket says 172.21.15.161:33586) 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 -- 172.21.15.161:0/75716107 learned_addr learned my addr 172.21.15.161:0/75716107 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dbb7fe700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dbc15e940 0x7f6dbc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da4003a30 0x7f6dbc14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 -- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da4003a30 msgr2=0x7f6dbc14e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da4003a30 0x7f6dbc14e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 -- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dbc15e940 msgr2=0x7f6dbc0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dbc15e940 0x7f6dbc0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 -- 172.21.15.161:0/75716107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0b0e60 con 0x7f6dbc0b1660 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dba7fc700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0011e0 tx=0x7f6dac007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00f6c0 con 0x7f6dbc0b1660 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00f840 con 0x7f6dbc0b1660 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc0b1140 con 0x7f6dbc0b1660 2023-08-10T10:30:02.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00fbf0 con 0x7f6dbc0b1660 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.188+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc0b0550 con 0x7f6dbc0b1660 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.189+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc0b1380 con 0x7f6dbc0b1660 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.190+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6dac00fd50 con 0x7f6dbc0b1660 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.190+0000 7f6da37fe700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 0x7f6da806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.190+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f6dac0892d0 con 0x7f6dbc0b1660 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.190+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 0x7f6da806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:02.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.190+0000 7f6dbaffd700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 0x7f6da806d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6db00090b0 tx=0x7f6db0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:02.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.195+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6dbc0b1380 con 0x7f6dbc0b1660 2023-08-10T10:30:02.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:02.385+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6dbc0b1380 con 0x7f6dbc0b1660 2023-08-10T10:30:02.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:02.548 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:03.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.040+0000 7f6da37fe700 1 -- 172.21.15.161:0/75716107 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6dbc0b1380 con 0x7f6dbc0b1660 2023-08-10T10:30:03.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 msgr2=0x7f6da806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 0x7f6da806d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6db00090b0 tx=0x7f6db0008030 comp rx=0 tx=0).stop 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 msgr2=0x7f6dbc0ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0011e0 tx=0x7f6dac007620 comp rx=0 tx=0).stop 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 shutdown_connections 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f6da806ace0 0x7f6da806d1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dbc15e940 0x7f6dbc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da4003a30 0x7f6dbc14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 --2- 172.21.15.161:0/75716107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dbc0b1660 0x7f6dbc0ada30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.044+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 >> 172.21.15.161:0/75716107 conn(0x7f6dbc09a140 msgr2=0x7f6dbc06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:03.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.046+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 shutdown_connections 2023-08-10T10:30:03.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.047+0000 7f6dc1473700 1 -- 172.21.15.161:0/75716107 wait complete. 2023-08-10T10:30:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-08-10T10:30:03.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:30:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.191+0000 7f00c3c35700 1 Processor -- start 2023-08-10T10:30:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.191+0000 7f00c3c35700 1 -- start start 2023-08-10T10:30:03.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c3c35700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00bc15e5e0 0x7f00bc0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c3c35700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc15e9c0 con 0x7f00bc0cb920 2023-08-10T10:30:03.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c3c35700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc0cc1c0 con 0x7f00bc0cde10 2023-08-10T10:30:03.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c3c35700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc0cc4a0 con 0x7f00bc15e5e0 2023-08-10T10:30:03.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c11d0700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f00bc0cb920 0x7f00bc0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38834/0 (socket says 172.21.15.161:38834) 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c11d0700 1 -- 172.21.15.161:0/2339809112 learned_addr learned my addr 172.21.15.161:0/2339809112 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449959756 0 0) 0x7f00bc15e9c0 con 0x7f00bc0cb920 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c19d1700 1 --2- 172.21.15.161:0/2339809112 >> v2:172.21.15.175:3300/0 conn(0x7f00bc15e5e0 0x7f00bc0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a80035b0 con 0x7f00bc0cb920 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2997760461 0 0) 0x7f00a80035b0 con 0x7f00bc0cb920 2023-08-10T10:30:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 >> v2:172.21.15.175:3300/0 conn(0x7f00bc15e5e0 msgr2=0x7f00bc0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 --2- 172.21.15.161:0/2339809112 >> v2:172.21.15.175:3300/0 conn(0x7f00bc15e5e0 0x7f00bc0cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 >> v1:172.21.15.175:6789/0 conn(0x7f00bc0cde10 legacy=0x7f00bc0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0cc780 con 0x7f00bc0cb920 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f00ac001670 con 0x7f00bc0cb920 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 >> v1:172.21.15.161:6789/0 conn(0x7f00bc0cb920 legacy=0x7f00bc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8003a00 0x7f00a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.192+0000 7f00c09cf700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00a8004850 0x7f00a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 0x7f00a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0cc4a0 con 0x7f00a8005210 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a800c0b0 con 0x7f00a8003a00 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a800c270 con 0x7f00a8004850 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 0x7f00a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c19d1700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8003a00 0x7f00a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c11d0700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00a8004850 0x7f00a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 -- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00a8004850 msgr2=0x7f00a8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00a8004850 0x7f00a8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 -- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8003a00 msgr2=0x7f00a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8003a00 0x7f00a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 -- 172.21.15.161:0/2339809112 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80035b0 con 0x7f00a8005210 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 -- 172.21.15.161:0/2339809112 reap_dead start 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c21d2700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 0x7f00a800ba10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00b4001ed0 tx=0x7f00a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be055c71af4bec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400cca0 con 0x7f00a8005210 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400ce20 con 0x7f00a8005210 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.193+0000 7f00c09cf700 1 -- 172.21.15.161:0/2339809112 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4003c40 con 0x7f00a8005210 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 -- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 msgr2=0x7f00a800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 0x7f00a800ba10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00b4001ed0 tx=0x7f00a8005880 comp rx=0 tx=0).stop 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 -- 172.21.15.161:0/2339809112 shutdown_connections 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 --2- 172.21.15.161:0/2339809112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00a8005210 0x7f00a800ba10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 -- 172.21.15.161:0/2339809112 >> 172.21.15.161:0/2339809112 conn(0x7f00bc09a140 msgr2=0x7f00bc0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:03.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 -- 172.21.15.161:0/2339809112 shutdown_connections 2023-08-10T10:30:03.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.194+0000 7f00c3c35700 1 -- 172.21.15.161:0/2339809112 wait complete. 2023-08-10T10:30:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.195+0000 7f00c3c35700 1 Processor -- start 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.195+0000 7f00c3c35700 1 -- start start 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8005210 0x7f00bc156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00bc158d80 0x7f00bc06e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0b1580 con 0x7f00bc158920 2023-08-10T10:30:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0b1860 con 0x7f00a8005210 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c3c35700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0b1b40 con 0x7f00bc158d80 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33606/0 (socket says 172.21.15.161:33606) 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 -- 172.21.15.161:0/3513231804 learned_addr learned my addr 172.21.15.161:0/3513231804 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c19d1700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8005210 0x7f00bc156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c21d2700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00bc158d80 0x7f00bc06e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 -- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00bc158d80 msgr2=0x7f00bc06e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00bc158d80 0x7f00bc06e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 -- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8005210 msgr2=0x7f00bc156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8005210 0x7f00bc156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 -- 172.21.15.161:0/3513231804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0b1e20 con 0x7f00bc158920 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.196+0000 7f00c11d0700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0072c0 tx=0x7f00ac0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.197+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00f6c0 con 0x7f00bc158920 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.197+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00f840 con 0x7f00bc158920 2023-08-10T10:30:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.197+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc0b11e0 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.197+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00fbf0 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.197+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc156e40 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.198+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc04ecc0 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.198+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00ac00fd50 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.198+0000 7f00b27fc700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 0x7f00a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.199+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f00ac089360 con 0x7f00bc158920 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.199+0000 7f00c19d1700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 0x7f00a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.199+0000 7f00c19d1700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 0x7f00a006d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0b2a00 tx=0x7f00b8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.203+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00ac054480 con 0x7f00bc158920 2023-08-10T10:30:03.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:03.436+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f00bc06b700 con 0x7f00bc158920 2023-08-10T10:30:04.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.066+0000 7f00b27fc700 1 -- 172.21.15.161:0/3513231804 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f00ac057aa0 con 0x7f00bc158920 2023-08-10T10:30:04.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 msgr2=0x7f00a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 0x7f00a006d1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0b2a00 tx=0x7f00b8009210 comp rx=0 tx=0).stop 2023-08-10T10:30:04.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 msgr2=0x7f00bc06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0072c0 tx=0x7f00ac0075d0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 shutdown_connections 2023-08-10T10:30:04.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f00a006ad10 0x7f00a006d1d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00bc158d80 0x7f00bc06e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a8005210 0x7f00bc156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 --2- 172.21.15.161:0/3513231804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00bc158920 0x7f00bc06e0f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 >> 172.21.15.161:0/3513231804 conn(0x7f00bc09a140 msgr2=0x7f00bc15ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 shutdown_connections 2023-08-10T10:30:04.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.071+0000 7f00c3c35700 1 -- 172.21.15.161:0/3513231804 wait complete. 2023-08-10T10:30:04.074 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 5 and data pool 6 2023-08-10T10:30:04.090 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:04.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.214+0000 7f4097bec700 1 Processor -- start 2023-08-10T10:30:04.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.215+0000 7f4097bec700 1 -- start start 2023-08-10T10:30:04.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.215+0000 7f4097bec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f40900c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.215+0000 7f4097bec700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900cc780 con 0x7f40900cd7e0 2023-08-10T10:30:04.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.215+0000 7f4097bec700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900cca60 con 0x7f409015b050 2023-08-10T10:30:04.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.215+0000 7f4097bec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900ccd40 con 0x7f40900cdc90 2023-08-10T10:30:04.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4095187700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f40900cd7e0 0x7f40900c52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38852/0 (socket says 172.21.15.161:38852) 2023-08-10T10:30:04.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4095187700 1 -- 172.21.15.161:0/1115855751 learned_addr learned my addr 172.21.15.161:0/1115855751 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:04.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4096189700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f40900c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302149808 0 0) 0x7f40900cc780 con 0x7f40900cd7e0 2023-08-10T10:30:04.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c0035b0 con 0x7f40900cd7e0 2023-08-10T10:30:04.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708175371 0 0) 0x7f40900cca60 con 0x7f409015b050 2023-08-10T10:30:04.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40900cc780 con 0x7f409015b050 2023-08-10T10:30:04.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527198129 0 0) 0x7f407c0035b0 con 0x7f40900cd7e0 2023-08-10T10:30:04.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 msgr2=0x7f40900c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f40900c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 >> v1:172.21.15.175:6789/0 conn(0x7f409015b050 legacy=0x7f40900d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900c4ae0 con 0x7f40900cd7e0 2023-08-10T10:30:04.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f408c001670 con 0x7f40900cd7e0 2023-08-10T10:30:04.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4096189700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f40900c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:04.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 >> v1:172.21.15.161:6789/0 conn(0x7f40900cd7e0 legacy=0x7f40900c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c003bc0 0x7f407c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f407c004850 0x7f407c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f407c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900ccd40 con 0x7f407c004850 2023-08-10T10:30:04.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c00ba40 con 0x7f407c003bc0 2023-08-10T10:30:04.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c00bc00 con 0x7f40900cdc90 2023-08-10T10:30:04.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4095187700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f407c004850 0x7f407c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4095988700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c003bc0 0x7f407c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.216+0000 7f4096189700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f407c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 -- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 msgr2=0x7f407c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cdc90 0x7f407c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 -- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c003bc0 msgr2=0x7f407c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c003bc0 0x7f407c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 -- 172.21.15.161:0/1115855751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009a70 con 0x7f407c004850 2023-08-10T10:30:04.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4095187700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f407c004850 0x7f407c004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f408c001eb0 tx=0x7f407c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77249c2e2cbdae9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00cd20 con 0x7f407c004850 2023-08-10T10:30:04.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c005960 con 0x7f407c004850 2023-08-10T10:30:04.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4094986700 1 -- 172.21.15.161:0/1115855751 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00cea0 con 0x7f407c004850 2023-08-10T10:30:04.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4097bec700 1 -- 172.21.15.161:0/1115855751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f407c004850 msgr2=0x7f407c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4097bec700 1 --2- 172.21.15.161:0/1115855751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f407c004850 0x7f407c004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f408c001eb0 tx=0x7f407c005880 comp rx=0 tx=0).stop 2023-08-10T10:30:04.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4096189700 1 -- 172.21.15.161:0/1115855751 reap_dead start 2023-08-10T10:30:04.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4097bec700 1 -- 172.21.15.161:0/1115855751 shutdown_connections 2023-08-10T10:30:04.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.217+0000 7f4097bec700 1 -- 172.21.15.161:0/1115855751 >> 172.21.15.161:0/1115855751 conn(0x7f409009a150 msgr2=0x7f40900d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.218+0000 7f4097bec700 1 -- 172.21.15.161:0/1115855751 shutdown_connections 2023-08-10T10:30:04.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.218+0000 7f4097bec700 1 -- 172.21.15.161:0/1115855751 wait complete. 2023-08-10T10:30:04.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 Processor -- start 2023-08-10T10:30:04.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 -- start start 2023-08-10T10:30:04.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 0x7f40900c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900ca410 0x7f40900b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900caf50 con 0x7f40900b2390 2023-08-10T10:30:04.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b2820 con 0x7f407c004850 2023-08-10T10:30:04.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.219+0000 7f4097bec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900ca990 con 0x7f40900ca410 2023-08-10T10:30:04.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33626/0 (socket says 172.21.15.161:33626) 2023-08-10T10:30:04.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 -- 172.21.15.161:0/1983106527 learned_addr learned my addr 172.21.15.161:0/1983106527 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:04.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4095187700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900ca410 0x7f40900b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4095988700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 0x7f40900c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 -- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900ca410 msgr2=0x7f40900b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900ca410 0x7f40900b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 -- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 msgr2=0x7f40900c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 0x7f40900c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 -- 172.21.15.161:0/1983106527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900cac70 con 0x7f40900b2390 2023-08-10T10:30:04.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4095988700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 0x7f40900c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:04.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4096189700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4090071d50 tx=0x7f408800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800e040 con 0x7f40900b2390 2023-08-10T10:30:04.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800f040 con 0x7f40900b2390 2023-08-10T10:30:04.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088003c60 con 0x7f40900b2390 2023-08-10T10:30:04.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409014de40 con 0x7f40900b2390 2023-08-10T10:30:04.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.220+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4090150aa0 con 0x7f40900b2390 2023-08-10T10:30:04.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.221+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409014dca0 con 0x7f40900b2390 2023-08-10T10:30:04.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.222+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4088015430 con 0x7f40900b2390 2023-08-10T10:30:04.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.222+0000 7f40867fc700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 0x7f407406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.222+0000 7f4095988700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 0x7f407406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.222+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4088089b30 con 0x7f40900b2390 2023-08-10T10:30:04.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.222+0000 7f4095988700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 0x7f407406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4080005580 tx=0x7f4080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.226+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f409014dca0 con 0x7f40900b2390 2023-08-10T10:30:04.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.416+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40900d1bf0 con 0x7f40900b2390 2023-08-10T10:30:04.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.417+0000 7f40867fc700 1 -- 172.21.15.161:0/1983106527 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f40900d1bf0 con 0x7f40900b2390 2023-08-10T10:30:04.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:04.419 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":36,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:30:03.437648+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:01.665825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:02.403709+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:04.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 msgr2=0x7f407406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 0x7f407406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4080005580 tx=0x7f4080009040 comp rx=0 tx=0).stop 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 msgr2=0x7f409006b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4090071d50 tx=0x7f408800f490 comp rx=0 tx=0).stop 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 shutdown_connections 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f407406ace0 0x7f407406d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40900b2390 0x7f409006b2a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f407c004850 0x7f40900c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 --2- 172.21.15.161:0/1983106527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900ca410 0x7f40900b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 >> 172.21.15.161:0/1983106527 conn(0x7f409009a150 msgr2=0x7f40900b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 shutdown_connections 2023-08-10T10:30:04.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.419+0000 7f4097bec700 1 -- 172.21.15.161:0/1983106527 wait complete. 2023-08-10T10:30:04.433 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:04.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.553+0000 7f7985ba0700 1 Processor -- start 2023-08-10T10:30:04.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.553+0000 7f7985ba0700 1 -- start start 2023-08-10T10:30:04.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7985ba0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800cef90 0x7f79800ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7985ba0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800b02a0 con 0x7f798015ada0 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7985ba0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800cbb30 con 0x7f79800cdcb0 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7985ba0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800cf460 con 0x7f79800cef90 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7984b9e700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f798015ada0 0x7f79800cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38870/0 (socket says 172.21.15.161:38870) 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.554+0000 7f7984b9e700 1 -- 172.21.15.161:0/3991933230 learned_addr learned my addr 172.21.15.161:0/3991933230 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725623870 0 0) 0x7f79800b02a0 con 0x7f798015ada0 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79700035b0 con 0x7f798015ada0 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f798539f700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800cef90 0x7f79800ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085051614 0 0) 0x7f79700035b0 con 0x7f798015ada0 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800cef90 msgr2=0x7f79800ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800cef90 0x7f79800ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 >> v1:172.21.15.175:6789/0 conn(0x7f79800cdcb0 legacy=0x7f79800ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800cf740 con 0x7f798015ada0 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f79740017f0 con 0x7f798015ada0 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 >> v1:172.21.15.161:6789/0 conn(0x7f798015ada0 legacy=0x7f79800cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7970003a30 0x7f7970003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7970004850 0x7f7970004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970005210 0x7f797000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800cf460 con 0x7f7970004850 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797000c110 con 0x7f7970005210 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797000c2d0 con 0x7f7970003a30 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f798539f700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800cef90 0x7f79800ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:04.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7970004850 0x7f7970004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f7984b9e700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7970003a30 0x7f7970003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f798539f700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970005210 0x7f797000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 -- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7970003a30 msgr2=0x7f7970003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7970003a30 0x7f7970003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 -- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970005210 msgr2=0x7f797000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970005210 0x7f797000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 -- 172.21.15.161:0/3991933230 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700035b0 con 0x7f7970004850 2023-08-10T10:30:04.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f7984b9e700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7970003a30 0x7f7970003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.555+0000 7f797ffff700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7970004850 0x7f7970004cd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f796c001800 tx=0x7f7970005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e71637a92d7b8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0012f0 con 0x7f7970004850 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0052f0 con 0x7f7970004850 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f797f7fe700 1 -- 172.21.15.161:0/3991933230 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c006860 con 0x7f7970004850 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 -- 172.21.15.161:0/3991933230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7970004850 msgr2=0x7f7970004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 --2- 172.21.15.161:0/3991933230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7970004850 0x7f7970004cd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f796c001800 tx=0x7f7970005880 comp rx=0 tx=0).stop 2023-08-10T10:30:04.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f798539f700 1 -- 172.21.15.161:0/3991933230 reap_dead start 2023-08-10T10:30:04.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 -- 172.21.15.161:0/3991933230 shutdown_connections 2023-08-10T10:30:04.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 -- 172.21.15.161:0/3991933230 >> 172.21.15.161:0/3991933230 conn(0x7f7980099ff0 msgr2=0x7f79800d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 -- 172.21.15.161:0/3991933230 shutdown_connections 2023-08-10T10:30:04.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.556+0000 7f7985ba0700 1 -- 172.21.15.161:0/3991933230 wait complete. 2023-08-10T10:30:04.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.557+0000 7f7985ba0700 1 Processor -- start 2023-08-10T10:30:04.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.557+0000 7f7985ba0700 1 -- start start 2023-08-10T10:30:04.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 0x7f798014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 0x7f79800c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014d5e0 con 0x7f79800c82c0 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c9410 con 0x7f7970004850 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f7985ba0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c8800 con 0x7f79800b3bc0 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f798539f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f798539f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33648/0 (socket says 172.21.15.161:33648) 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.558+0000 7f798539f700 1 -- 172.21.15.161:0/765925224 learned_addr learned my addr 172.21.15.161:0/765925224 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:04.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f7984b9e700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 0x7f798014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f797ffff700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 0x7f79800c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 -- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 msgr2=0x7f79800c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 0x7f79800c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 -- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 msgr2=0x7f798014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 0x7f798014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 -- 172.21.15.161:0/765925224 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800c8ae0 con 0x7f79800c82c0 2023-08-10T10:30:04.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f7984b9e700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 0x7f798014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f797ffff700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 0x7f79800c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f798539f700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f79800cf390 tx=0x7f7978004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978007b50 con 0x7f79800c82c0 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800f050 con 0x7f79800c82c0 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79800c8dc0 con 0x7f79800c82c0 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978014410 con 0x7f79800c82c0 2023-08-10T10:30:04.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.559+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79801584d0 con 0x7f79800c82c0 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.560+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798004ecc0 con 0x7f79800c82c0 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.560+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7978014570 con 0x7f79800c82c0 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.561+0000 7f797d7fa700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 0x7f796406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.561+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79780898f0 con 0x7f79800c82c0 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.561+0000 7f7984b9e700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 0x7f796406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.561+0000 7f7984b9e700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 0x7f796406d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7974005a70 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.565+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f79780549a0 con 0x7f79800c82c0 2023-08-10T10:30:04.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.753+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79800ce640 con 0x7f79800c82c0 2023-08-10T10:30:04.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.755+0000 7f797d7fa700 1 -- 172.21.15.161:0/765925224 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f7978057fc0 con 0x7f79800c82c0 2023-08-10T10:30:04.756 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:04.757 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:30:04.442492+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:01.665825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:02.403709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 msgr2=0x7f796406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 0x7f796406d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7974005a70 tx=0x7f7974009040 comp rx=0 tx=0).stop 2023-08-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 msgr2=0x7f798006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f79800cf390 tx=0x7f7978004970 comp rx=0 tx=0).stop 2023-08-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 shutdown_connections 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f796406ace0 0x7f796406d1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79800c82c0 0x7f798006dd40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970004850 0x7f798014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 --2- 172.21.15.161:0/765925224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79800b3bc0 0x7f79800c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 >> 172.21.15.161:0/765925224 conn(0x7f7980099ff0 msgr2=0x7f79800b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 shutdown_connections 2023-08-10T10:30:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.757+0000 7f7985ba0700 1 -- 172.21.15.161:0/765925224 wait complete. 2023-08-10T10:30:04.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:30:04.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.892+0000 7fe347ede700 1 Processor -- start 2023-08-10T10:30:04.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.892+0000 7fe347ede700 1 -- start start 2023-08-10T10:30:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe347ede700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3400cb9f0 0x7fe3400b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe347ede700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe34006a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe347ede700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34006ab00 con 0x7fe340160d20 2023-08-10T10:30:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe347ede700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe340071950 con 0x7fe3400cb9f0 2023-08-10T10:30:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe347ede700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400b2660 con 0x7fe34006a190 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe345c7a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3400cb9f0 0x7fe3400b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe345c7a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3400cb9f0 0x7fe3400b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33652/0 (socket says 172.21.15.161:33652) 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe345c7a700 1 -- 172.21.15.161:0/1267160545 learned_addr learned my addr 172.21.15.161:0/1267160545 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.893+0000 7fe34647b700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe34006a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe345c7a700 1 -- 172.21.15.161:0/1267160545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 msgr2=0x7fe34006a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe345c7a700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe34006a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe345c7a700 1 -- 172.21.15.161:0/1267160545 >> v1:172.21.15.175:6789/0 conn(0x7fe340160d20 legacy=0x7fe3400cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe345c7a700 1 -- 172.21.15.161:0/1267160545 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34006dc10 con 0x7fe3400cb9f0 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe34647b700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe34006a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe345c7a700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3400cb9f0 0x7fe3400b2120 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098f0 tx=0x7fe330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd572b5996a211e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe344c78700 1 -- 172.21.15.161:0/1267160545 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330004230 con 0x7fe3400cb9f0 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe344c78700 1 -- 172.21.15.161:0/1267160545 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330004390 con 0x7fe3400cb9f0 2023-08-10T10:30:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe344c78700 1 -- 172.21.15.161:0/1267160545 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300036a0 con 0x7fe3400cb9f0 2023-08-10T10:30:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 -- 172.21.15.161:0/1267160545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3400cb9f0 msgr2=0x7fe3400b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3400cb9f0 0x7fe3400b2120 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098f0 tx=0x7fe330009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 -- 172.21.15.161:0/1267160545 shutdown_connections 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe34006a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 --2- 172.21.15.161:0/1267160545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3400cb9f0 0x7fe3400b2120 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.894+0000 7fe347ede700 1 -- 172.21.15.161:0/1267160545 >> 172.21.15.161:0/1267160545 conn(0x7fe3400cc740 msgr2=0x7fe3400ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.895+0000 7fe347ede700 1 -- 172.21.15.161:0/1267160545 shutdown_connections 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.895+0000 7fe347ede700 1 -- 172.21.15.161:0/1267160545 wait complete. 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 Processor -- start 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 -- start start 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe3400b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 0x7fe3400aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400af1f0 con 0x7fe340160d20 2023-08-10T10:30:04.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400b1de0 con 0x7fe3400cb9f0 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.896+0000 7fe347ede700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400b2030 con 0x7fe34006a190 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33662/0 (socket says 172.21.15.161:33662) 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 -- 172.21.15.161:0/3132335586 learned_addr learned my addr 172.21.15.161:0/3132335586 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe345c7a700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe3400b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe345479700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 0x7fe3400aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 -- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 msgr2=0x7fe3400b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe3400b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 -- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 msgr2=0x7fe3400aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 0x7fe3400aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 -- 172.21.15.161:0/3132335586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009550 con 0x7fe340160d20 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe345479700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 0x7fe3400aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe34647b700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe338007e20 tx=0x7fe33800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33800de90 con 0x7fe340160d20 2023-08-10T10:30:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33800f040 con 0x7fe340160d20 2023-08-10T10:30:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338003c60 con 0x7fe340160d20 2023-08-10T10:30:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3400af440 con 0x7fe340160d20 2023-08-10T10:30:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.897+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3400afa00 con 0x7fe340160d20 2023-08-10T10:30:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.898+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3400afc20 con 0x7fe340160d20 2023-08-10T10:30:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.899+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe338004030 con 0x7fe340160d20 2023-08-10T10:30:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.899+0000 7fe3367fc700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 0x7fe32406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.899+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3380895d0 con 0x7fe340160d20 2023-08-10T10:30:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.899+0000 7fe345c7a700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 0x7fe32406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.899+0000 7fe345c7a700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 0x7fe32406d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe330009130 tx=0x7fe330008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:04.903+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe338054680 con 0x7fe340160d20 2023-08-10T10:30:05.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:05.136+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe34004ecc0 con 0x7fe340160d20 2023-08-10T10:30:06.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.081+0000 7fe3367fc700 1 -- 172.21.15.161:0/3132335586 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe338057ca0 con 0x7fe340160d20 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.083+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 msgr2=0x7fe32406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.083+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 0x7fe32406d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe330009130 tx=0x7fe330008030 comp rx=0 tx=0).stop 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.083+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 msgr2=0x7fe34015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.083+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe338007e20 tx=0x7fe33800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 shutdown_connections 2023-08-10T10:30:06.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe32406ace0 0x7fe32406d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe340160d20 0x7fe34015eb90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe34006a190 0x7fe3400b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 --2- 172.21.15.161:0/3132335586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3400cb9f0 0x7fe3400aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 >> 172.21.15.161:0/3132335586 conn(0x7fe3400cc740 msgr2=0x7fe3401602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 shutdown_connections 2023-08-10T10:30:06.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.084+0000 7fe347ede700 1 -- 172.21.15.161:0/3132335586 wait complete. 2023-08-10T10:30:06.100 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:30:06.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:30:06.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.230+0000 7f9111794700 1 Processor -- start 2023-08-10T10:30:06.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.230+0000 7f9111794700 1 -- start start 2023-08-10T10:30:06.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f9111794700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f910c0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f9111794700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f910c0d0210 0x7f910c0cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f9111794700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0cead0 con 0x7f910c160cf0 2023-08-10T10:30:06.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f9111794700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c0cedb0 con 0x7f910c0d0210 2023-08-10T10:30:06.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f9111794700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cf090 con 0x7f910c160910 2023-08-10T10:30:06.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f910b7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f910c160cf0 0x7f910c0d0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38908/0 (socket says 172.21.15.161:38908) 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.231+0000 7f910b7fe700 1 -- 172.21.15.161:0/2348690722 learned_addr learned my addr 172.21.15.161:0/2348690722 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2348690722 >> v2:172.21.15.175:3300/0 conn(0x7f910c0d0210 0x7f910c0cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910affd700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f910c0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740467600 0 0) 0x7f910c0cead0 con 0x7f910c160cf0 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f40035b0 con 0x7f910c160cf0 2023-08-10T10:30:06.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851804009 0 0) 0x7f90f40035b0 con 0x7f910c160cf0 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 msgr2=0x7f910c0d3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f910c0d3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 >> v2:172.21.15.175:3300/0 conn(0x7f910c0d0210 msgr2=0x7f910c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 --2- 172.21.15.161:0/2348690722 >> v2:172.21.15.175:3300/0 conn(0x7f910c0d0210 0x7f910c0cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0b2c40 con 0x7f910c160cf0 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7f91040019f0 con 0x7f910c160cf0 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 >> v1:172.21.15.161:6789/0 conn(0x7f910c160cf0 legacy=0x7f910c0d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f4003a00 0x7f90f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f90f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f90f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cedb0 con 0x7f90f4004850 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cf090 con 0x7f90f4003a00 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f400ba10 con 0x7f910c160910 2023-08-10T10:30:06.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f90f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910affd700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f4003a00 0x7f90f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910b7fe700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f90f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 -- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 msgr2=0x7f90f4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c160910 0x7f90f4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 -- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f4003a00 msgr2=0x7f90f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f4003a00 0x7f90f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.232+0000 7f910a7fc700 1 -- 172.21.15.161:0/2348690722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40035b0 con 0x7f90f4004850 2023-08-10T10:30:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f90f4004cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009b60 tx=0x7f90f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3504e0bed2a7f2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00e6c0 con 0x7f90f4004850 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00e820 con 0x7f90f4004850 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9109ffb700 1 -- 172.21.15.161:0/2348690722 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00eb90 con 0x7f90f4004850 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 -- 172.21.15.161:0/2348690722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 msgr2=0x7f90f4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 --2- 172.21.15.161:0/2348690722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f90f4004cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009b60 tx=0x7f90f4005880 comp rx=0 tx=0).stop 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f910b7fe700 1 -- 172.21.15.161:0/2348690722 reap_dead start 2023-08-10T10:30:06.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 -- 172.21.15.161:0/2348690722 shutdown_connections 2023-08-10T10:30:06.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 -- 172.21.15.161:0/2348690722 >> 172.21.15.161:0/2348690722 conn(0x7f910c0d3080 msgr2=0x7f910c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:06.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 -- 172.21.15.161:0/2348690722 shutdown_connections 2023-08-10T10:30:06.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.233+0000 7f9111794700 1 -- 172.21.15.161:0/2348690722 wait complete. 2023-08-10T10:30:06.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 Processor -- start 2023-08-10T10:30:06.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 -- start start 2023-08-10T10:30:06.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c0cc760 0x7f910c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f910c0c6770 0x7f910c0c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cd120 con 0x7f90f4004850 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0c7a20 con 0x7f910c0c6770 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f9111794700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1f7370 con 0x7f910c0cc760 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.235+0000 7f910affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33678/0 (socket says 172.21.15.161:33678) 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 -- 172.21.15.161:0/2789430333 learned_addr learned my addr 172.21.15.161:0/2789430333 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c0cc760 0x7f910c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 -- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c0cc760 msgr2=0x7f910c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c0cc760 0x7f910c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910b7fe700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f910c0c6770 0x7f910c0c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 -- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f910c0c6770 msgr2=0x7f910c0c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f910c0c6770 0x7f910c0c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 -- 172.21.15.161:0/2789430333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0c7460 con 0x7f90f4004850 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f910affd700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91000119a0 tx=0x7f9100011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000f940 con 0x7f90f4004850 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000faa0 con 0x7f90f4004850 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c0c7740 con 0x7f90f4004850 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000fe30 con 0x7f90f4004850 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.236+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c0ca560 con 0x7f90f4004850 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.237+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c0cd450 con 0x7f90f4004850 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.237+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9100014440 con 0x7f90f4004850 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.238+0000 7f90f37fe700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 0x7f90f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.238+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9100089a10 con 0x7f90f4004850 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.238+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 0x7f90f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.238+0000 7f910a7fc700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 0x7f90f806d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f910c15e4e0 tx=0x7f90fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.242+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9100054b50 con 0x7f90f4004850 2023-08-10T10:30:06.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:06.474+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f910c04ecc0 con 0x7f90f4004850 2023-08-10T10:30:07.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.087+0000 7f90f37fe700 1 -- 172.21.15.161:0/2789430333 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9100058170 con 0x7f90f4004850 2023-08-10T10:30:07.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 msgr2=0x7f90f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 0x7f90f806d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f910c15e4e0 tx=0x7f90fc008030 comp rx=0 tx=0).stop 2023-08-10T10:30:07.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 msgr2=0x7f910c15c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91000119a0 tx=0x7f9100011d60 comp rx=0 tx=0).stop 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 shutdown_connections 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f90f806ace0 0x7f90f806d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f910c0c6770 0x7f910c0c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90f4004850 0x7f910c15c860 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 --2- 172.21.15.161:0/2789430333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f910c0cc760 0x7f910c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 >> 172.21.15.161:0/2789430333 conn(0x7f910c0d3080 msgr2=0x7f910c0d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 shutdown_connections 2023-08-10T10:30:07.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.090+0000 7f9111794700 1 -- 172.21.15.161:0/2789430333 wait complete. 2023-08-10T10:30:07.105 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:30:07.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:07.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.227+0000 7fea20769700 1 Processor -- start 2023-08-10T10:30:07.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.227+0000 7fea20769700 1 -- start start 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea20769700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea18154620 0x7fea180717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea20769700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea1806e650 0x7fea1815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea20769700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1815b290 con 0x7fea18071d10 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea20769700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c5890 con 0x7fea18154620 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea20769700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815b570 con 0x7fea1806e650 2023-08-10T10:30:07.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea18154620 0x7fea180717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea18154620 0x7fea180717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33686/0 (socket says 172.21.15.161:33686) 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 -- 172.21.15.161:0/4144307050 learned_addr learned my addr 172.21.15.161:0/4144307050 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1ed06700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea1806e650 0x7fea1815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 -- 172.21.15.161:0/4144307050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea1806e650 msgr2=0x7fea1815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea1806e650 0x7fea1815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.228+0000 7fea1e505700 1 -- 172.21.15.161:0/4144307050 >> v1:172.21.15.175:6789/0 conn(0x7fea18071d10 legacy=0x7fea1806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea1e505700 1 -- 172.21.15.161:0/4144307050 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18070cf0 con 0x7fea18154620 2023-08-10T10:30:07.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea1e505700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18154620 0x7fea180717d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bb90 tx=0x7fea1400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d5553ea84c51bb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea1d503700 1 -- 172.21.15.161:0/4144307050 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400dd50 con 0x7fea18154620 2023-08-10T10:30:07.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea1d503700 1 -- 172.21.15.161:0/4144307050 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14010470 con 0x7fea18154620 2023-08-10T10:30:07.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea1d503700 1 -- 172.21.15.161:0/4144307050 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14010800 con 0x7fea18154620 2023-08-10T10:30:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 -- 172.21.15.161:0/4144307050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18154620 msgr2=0x7fea180717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18154620 0x7fea180717d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bb90 tx=0x7fea1400bea0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 -- 172.21.15.161:0/4144307050 shutdown_connections 2023-08-10T10:30:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea1806e650 0x7fea1815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 --2- 172.21.15.161:0/4144307050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18154620 0x7fea180717d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 -- 172.21.15.161:0/4144307050 >> 172.21.15.161:0/4144307050 conn(0x7fea180cfd70 msgr2=0x7fea180d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 -- 172.21.15.161:0/4144307050 shutdown_connections 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.229+0000 7fea20769700 1 -- 172.21.15.161:0/4144307050 wait complete. 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.231+0000 7fea20769700 1 Processor -- start 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.231+0000 7fea20769700 1 -- start start 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 0x7fea181446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea18154620 0x7fea18154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181562c0 con 0x7fea18071d10 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18155640 con 0x7fea1806e650 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea20769700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18155920 con 0x7fea18154620 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33694/0 (socket says 172.21.15.161:33694) 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 -- 172.21.15.161:0/3223717467 learned_addr learned my addr 172.21.15.161:0/3223717467 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1e505700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 0x7fea181446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1ed06700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea18154620 0x7fea18154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 -- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea18154620 msgr2=0x7fea18154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea18154620 0x7fea18154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 -- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 msgr2=0x7fea181446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 0x7fea181446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1dd04700 1 -- 172.21.15.161:0/3223717467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1400b7f0 con 0x7fea18071d10 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.232+0000 7fea1e505700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 0x7fea181446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:07.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea1dd04700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fea0800c480 tx=0x7fea0800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080052d0 con 0x7fea18071d10 2023-08-10T10:30:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08005430 con 0x7fea18071d10 2023-08-10T10:30:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18155c00 con 0x7fea18071d10 2023-08-10T10:30:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080038c0 con 0x7fea18071d10 2023-08-10T10:30:07.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.233+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18144bf0 con 0x7fea18071d10 2023-08-10T10:30:07.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.234+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18156400 con 0x7fea18071d10 2023-08-10T10:30:07.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.234+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea08003a20 con 0x7fea18071d10 2023-08-10T10:30:07.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.234+0000 7fea0effd700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 0x7fe9fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.235+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea08088930 con 0x7fea18071d10 2023-08-10T10:30:07.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.235+0000 7fea1e505700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 0x7fe9fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.235+0000 7fea1e505700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 0x7fe9fc06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bee0 tx=0x7fea14013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.239+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fea18156400 con 0x7fea18071d10 2023-08-10T10:30:07.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.469+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea18156400 con 0x7fea18071d10 2023-08-10T10:30:07.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.470+0000 7fea0effd700 1 -- 172.21.15.161:0/3223717467 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fea18156400 con 0x7fea18071d10 2023-08-10T10:30:07.471 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:07.471 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/461904854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":461904854},{"type":"v1","addr":"172.21.15.175:6835","nonce":461904854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5172,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1347697385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1347697385},{"type":"v1","addr":"172.21.15.161:6836","nonce":1347697385}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5175,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/363247557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":363247557},{"type":"v1","addr":"172.21.15.161:6837","nonce":363247557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:03.437960+0000","modified":"2023-08-10T10:30:07.080791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6834/1403779871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1403779871},{"type":"v1","addr":"172.21.15.175:6834","nonce":1403779871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:30:07.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 msgr2=0x7fe9fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 0x7fe9fc06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bee0 tx=0x7fea14013000 comp rx=0 tx=0).stop 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 msgr2=0x7fea181566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fea0800c480 tx=0x7fea0800c790 comp rx=0 tx=0).stop 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 shutdown_connections 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe9fc06ace0 0x7fe9fc06d1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea18154620 0x7fea18154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea1806e650 0x7fea181446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 --2- 172.21.15.161:0/3223717467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea18071d10 0x7fea181566e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 >> 172.21.15.161:0/3223717467 conn(0x7fea180cfd70 msgr2=0x7fea1815c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 shutdown_connections 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.472+0000 7fea20769700 1 -- 172.21.15.161:0/3223717467 wait complete. 2023-08-10T10:30:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 17 2023-08-10T10:30:07.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.604+0000 7f5c3577e700 1 Processor -- start 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 -- start start 2023-08-10T10:30:07.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c300cb8a0 0x7f5c300ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300ac850 con 0x7f5c301608b0 2023-08-10T10:30:07.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300cef20 con 0x7f5c300cb8a0 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.605+0000 7f5c3577e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3006a500 con 0x7f5c300ceab0 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2e7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c300cb8a0 0x7f5c300ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:47106/0 (socket says 172.21.15.161:47106) 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/2813245197 learned_addr learned my addr 172.21.15.161:0/2813245197 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2effd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5c301608b0 0x7f5c30160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:40730/0 (socket says 172.21.15.161:40730) 2023-08-10T10:30:07.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/2813245197 >> v2:172.21.15.175:3300/0 conn(0x7f5c300cb8a0 msgr2=0x7f5c300ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 --2- 172.21.15.161:0/2813245197 >> v2:172.21.15.175:3300/0 conn(0x7f5c300cb8a0 0x7f5c300ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/2813245197 >> v1:172.21.15.175:6789/0 conn(0x7f5c301608b0 legacy=0x7f5c30160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/2813245197 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30161630 con 0x7f5c300ceab0 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2f7fe700 1 --2- 172.21.15.161:0/2813245197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009e50 tx=0x7f5c2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0f67548855e473 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2dffb700 1 -- 172.21.15.161:0/2813245197 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800e070 con 0x7f5c300ceab0 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2dffb700 1 -- 172.21.15.161:0/2813245197 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800b910 con 0x7f5c300ceab0 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.606+0000 7f5c2dffb700 1 -- 172.21.15.161:0/2813245197 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800bcc0 con 0x7f5c300ceab0 2023-08-10T10:30:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 -- 172.21.15.161:0/2813245197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 msgr2=0x7f5c3006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 --2- 172.21.15.161:0/2813245197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009e50 tx=0x7f5c2800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 -- 172.21.15.161:0/2813245197 shutdown_connections 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 --2- 172.21.15.161:0/2813245197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3006a990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 --2- 172.21.15.161:0/2813245197 >> v2:172.21.15.175:3300/0 conn(0x7f5c300cb8a0 0x7f5c300ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 -- 172.21.15.161:0/2813245197 >> 172.21.15.161:0/2813245197 conn(0x7f5c300cf450 msgr2=0x7f5c300cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 -- 172.21.15.161:0/2813245197 shutdown_connections 2023-08-10T10:30:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.607+0000 7f5c3577e700 1 -- 172.21.15.161:0/2813245197 wait complete. 2023-08-10T10:30:07.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.608+0000 7f5c3577e700 1 Processor -- start 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.608+0000 7f5c3577e700 1 -- start start 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300cb8a0 0x7f5c30154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3015c7c0 con 0x7f5c301608b0 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3015c490 con 0x7f5c300cb8a0 2023-08-10T10:30:07.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c3577e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300c7580 con 0x7f5c300ceab0 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33710/0 (socket says 172.21.15.161:33710) 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/437179297 learned_addr learned my addr 172.21.15.161:0/437179297 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2e7fc700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2effd700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300cb8a0 0x7f5c30154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 msgr2=0x7f5c3015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300cb8a0 msgr2=0x7f5c30154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300cb8a0 0x7f5c30154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.609+0000 7f5c2f7fe700 1 -- 172.21.15.161:0/437179297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c28009b30 con 0x7f5c301608b0 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c2f7fe700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5c3006a640 tx=0x7f5c28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28004800 con 0x7f5c301608b0 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28004960 con 0x7f5c301608b0 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c300c7860 con 0x7f5c301608b0 2023-08-10T10:30:07.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2801c680 con 0x7f5c301608b0 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.610+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c300c7b40 con 0x7f5c301608b0 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.611+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3015c970 con 0x7f5c301608b0 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.611+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c2801c7e0 con 0x7f5c301608b0 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.612+0000 7f5c177fe700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 0x7f5c1c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.612+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c2808af90 con 0x7f5c301608b0 2023-08-10T10:30:07.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.612+0000 7f5c2effd700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 0x7f5c1c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.612+0000 7f5c2effd700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 0x7f5c1c06d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5c24000f60 tx=0x7f5c24007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.616+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5c280bd330 con 0x7f5c301608b0 2023-08-10T10:30:07.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.804+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c300c7cd0 con 0x7f5c301608b0 2023-08-10T10:30:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.805+0000 7f5c177fe700 1 -- 172.21.15.161:0/437179297 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f5c3015c970 con 0x7f5c301608b0 2023-08-10T10:30:07.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:07.807 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","created":"2023-08-10T10:28:38.629454+0000","modified":"2023-08-10T10:30:04.442492+0000","last_up_change":"2023-08-10T10:28:50.206231+0000","last_in_change":"2023-08-10T10:28:41.225985+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:28:52.227869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:28:57.135292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:01.665825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:02.403709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aaf33d21-dcda-4442-b577-25197c77f282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6825","nonce":4294644142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6827","nonce":4294644142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6831","nonce":4294644142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":4294644142},{"type":"v1","addr":"172.21.15.161:6829","nonce":4294644142}]},"public_addr":"172.21.15.161:6825/4294644142","cluster_addr":"172.21.15.161:6827/4294644142","heartbeat_back_addr":"172.21.15.161:6831/4294644142","heartbeat_front_addr":"172.21.15.161:6829/4294644142","state":["exists","up"]},{"osd":1,"uuid":"9b1d5a01-758b-4785-8334-b36d27d0cd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6811","nonce":77291645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6815","nonce":77291645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6823","nonce":77291645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":77291645},{"type":"v1","addr":"172.21.15.161:6820","nonce":77291645}]},"public_addr":"172.21.15.161:6811/77291645","cluster_addr":"172.21.15.161:6815/77291645","heartbeat_back_addr":"172.21.15.161:6823/77291645","heartbeat_front_addr":"172.21.15.161:6820/77291645","state":["exists","up"]},{"osd":2,"uuid":"e76635dd-599e-43cd-bac4-36d074db3e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6810","nonce":3808745509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6814","nonce":3808745509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6821","nonce":3808745509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3808745509},{"type":"v1","addr":"172.21.15.161:6818","nonce":3808745509}]},"public_addr":"172.21.15.161:6810/3808745509","cluster_addr":"172.21.15.161:6814/3808745509","heartbeat_back_addr":"172.21.15.161:6821/3808745509","heartbeat_front_addr":"172.21.15.161:6818/3808745509","state":["exists","up"]},{"osd":3,"uuid":"9f618dfb-63d0-4da7-bb5c-cd3fe2ffd6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6801","nonce":728219313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6803","nonce":728219313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6807","nonce":728219313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":728219313},{"type":"v1","addr":"172.21.15.161:6805","nonce":728219313}]},"public_addr":"172.21.15.161:6801/728219313","cluster_addr":"172.21.15.161:6803/728219313","heartbeat_back_addr":"172.21.15.161:6807/728219313","heartbeat_front_addr":"172.21.15.161:6805/728219313","state":["exists","up"]},{"osd":4,"uuid":"88a98da4-8342-4142-9d84-a1c44997d251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6801","nonce":3815453765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6803","nonce":3815453765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6807","nonce":3815453765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3815453765},{"type":"v1","addr":"172.21.15.175:6805","nonce":3815453765}]},"public_addr":"172.21.15.175:6801/3815453765","cluster_addr":"172.21.15.175:6803/3815453765","heartbeat_back_addr":"172.21.15.175:6807/3815453765","heartbeat_front_addr":"172.21.15.175:6805/3815453765","state":["exists","up"]},{"osd":5,"uuid":"35f0689e-ceb6-4f9c-a582-c91e7cedcf02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6825","nonce":902060377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6827","nonce":902060377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6831","nonce":902060377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":902060377},{"type":"v1","addr":"172.21.15.175:6829","nonce":902060377}]},"public_addr":"172.21.15.175:6825/902060377","cluster_addr":"172.21.15.175:6827/902060377","heartbeat_back_addr":"172.21.15.175:6831/902060377","heartbeat_front_addr":"172.21.15.175:6829/902060377","state":["exists","up"]},{"osd":6,"uuid":"f880f09d-e243-42c6-b467-70c07ecb7fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6809","nonce":4196020712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6811","nonce":4196020712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6815","nonce":4196020712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4196020712},{"type":"v1","addr":"172.21.15.175:6813","nonce":4196020712}]},"public_addr":"172.21.15.175:6809/4196020712","cluster_addr":"172.21.15.175:6811/4196020712","heartbeat_back_addr":"172.21.15.175:6815/4196020712","heartbeat_front_addr":"172.21.15.175:6813/4196020712","state":["exists","up"]},{"osd":7,"uuid":"07584d09-b2ab-409a-b0f0-d87050bb4974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6817","nonce":996591933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6819","nonce":996591933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6823","nonce":996591933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":996591933},{"type":"v1","addr":"172.21.15.175:6821","nonce":996591933}]},"public_addr":"172.21.15.175:6817/996591933","cluster_addr":"172.21.15.175:6819/996591933","heartbeat_back_addr":"172.21.15.175:6823/996591933","heartbeat_front_addr":"172.21.15.175:6821/996591933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.413614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.464444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.453009+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.332713+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.370913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.476858+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.378744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:28:46.479798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:07.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 msgr2=0x7f5c1c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 0x7f5c1c06d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5c24000f60 tx=0x7f5c24007ed0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 msgr2=0x7f5c3015cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5c3006a640 tx=0x7f5c28004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 shutdown_connections 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f5c1c06ad10 0x7f5c1c06d1d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c301608b0 0x7f5c3015cc50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300cb8a0 0x7f5c30154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 --2- 172.21.15.161:0/437179297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c300ceab0 0x7f5c3015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 >> 172.21.15.161:0/437179297 conn(0x7f5c300cf450 msgr2=0x7f5c300ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 shutdown_connections 2023-08-10T10:30:07.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.807+0000 7f5c3577e700 1 -- 172.21.15.161:0/437179297 wait complete. 2023-08-10T10:30:07.821 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:30:07.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:30:07.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.939+0000 7f99b8224700 1 Processor -- start 2023-08-10T10:30:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 -- start start 2023-08-10T10:30:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99b006df40 0x7f99b006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99b015a5c0 0x7f99b015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b0071ee0 con 0x7f99b0154620 2023-08-10T10:30:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00c5890 con 0x7f99b006df40 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.940+0000 7f99b8224700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b006e910 con 0x7f99b015a5c0 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99b006df40 0x7f99b006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99b006df40 0x7f99b006e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33716/0 (socket says 172.21.15.161:33716) 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 -- 172.21.15.161:0/991571636 learned_addr learned my addr 172.21.15.161:0/991571636 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b67c1700 1 --2- 172.21.15.161:0/991571636 >> v2:172.21.15.175:3300/0 conn(0x7f99b015a5c0 0x7f99b015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 -- 172.21.15.161:0/991571636 >> v2:172.21.15.175:3300/0 conn(0x7f99b015a5c0 msgr2=0x7f99b015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 --2- 172.21.15.161:0/991571636 >> v2:172.21.15.175:3300/0 conn(0x7f99b015a5c0 0x7f99b015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 -- 172.21.15.161:0/991571636 >> v1:172.21.15.175:6789/0 conn(0x7f99b0154620 legacy=0x7f99b00717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 -- 172.21.15.161:0/991571636 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b015b290 con 0x7f99b006df40 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b57bf700 1 --2- 172.21.15.161:0/991571636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b006df40 0x7f99b006e3d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f99b00c6590 tx=0x7f99ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a9bdbcf32c5fcf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b4fbe700 1 -- 172.21.15.161:0/991571636 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004230 con 0x7f99b006df40 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b4fbe700 1 -- 172.21.15.161:0/991571636 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac004390 con 0x7f99b006df40 2023-08-10T10:30:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.941+0000 7f99b4fbe700 1 -- 172.21.15.161:0/991571636 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0036a0 con 0x7f99b006df40 2023-08-10T10:30:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 -- 172.21.15.161:0/991571636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b006df40 msgr2=0x7f99b006e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 --2- 172.21.15.161:0/991571636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b006df40 0x7f99b006e3d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f99b00c6590 tx=0x7f99ac009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 -- 172.21.15.161:0/991571636 shutdown_connections 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 --2- 172.21.15.161:0/991571636 >> v2:172.21.15.175:3300/0 conn(0x7f99b015a5c0 0x7f99b015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 --2- 172.21.15.161:0/991571636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b006df40 0x7f99b006e3d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 -- 172.21.15.161:0/991571636 >> 172.21.15.161:0/991571636 conn(0x7f99b00cfd70 msgr2=0x7f99b00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 -- 172.21.15.161:0/991571636 shutdown_connections 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.942+0000 7f99b8224700 1 -- 172.21.15.161:0/991571636 wait complete. 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.943+0000 7f99b8224700 1 Processor -- start 2023-08-10T10:30:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.943+0000 7f99b8224700 1 -- start start 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b006df40 0x7f99b00b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b015a5c0 0x7f99b015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01482f0 con 0x7f99b0154620 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b014fee0 con 0x7f99b015a5c0 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b8224700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b014f2d0 con 0x7f99b006df40 2023-08-10T10:30:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33722/0 (socket says 172.21.15.161:33722) 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 -- 172.21.15.161:0/4172953690 learned_addr learned my addr 172.21.15.161:0/4172953690 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b5fc0700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b006df40 0x7f99b00b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b67c1700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b015a5c0 0x7f99b015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 -- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b006df40 msgr2=0x7f99b00b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b006df40 0x7f99b00b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 -- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b015a5c0 msgr2=0x7f99b015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b015a5c0 0x7f99b015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 -- 172.21.15.161:0/4172953690 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009550 con 0x7f99b0154620 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99b57bf700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009870 tx=0x7f99ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.944+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003c10 con 0x7f99b0154620 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.945+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac01f070 con 0x7f99b0154620 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.945+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b014f5b0 con 0x7f99b0154620 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.945+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011630 con 0x7f99b0154620 2023-08-10T10:30:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.945+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b014fb70 con 0x7f99b0154620 2023-08-10T10:30:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.945+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b014fd00 con 0x7f99b0154620 2023-08-10T10:30:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.946+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99ac021030 con 0x7f99b0154620 2023-08-10T10:30:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.946+0000 7f99a67fc700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 0x7f999406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.946+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99ac08ab20 con 0x7f99b0154620 2023-08-10T10:30:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.946+0000 7f99b5fc0700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 0x7f999406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.947+0000 7f99b5fc0700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 0x7f999406d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f99a0007fd0 tx=0x7f99a0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:07.951+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f99ac055d00 con 0x7f99b0154620 2023-08-10T10:30:08.019 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:30:08.018+0000 7f292e974700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:30:08.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.136+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99b0070cf0 con 0x7f999406ace0 2023-08-10T10:30:08.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.144+0000 7f99a67fc700 1 -- 172.21.15.161:0/4172953690 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298268 (secure 0 0 0) 0x7f99a0003a90 con 0x7f999406ace0 2023-08-10T10:30:08.148 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:08.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 msgr2=0x7f999406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 0x7f999406d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f99a0007fd0 tx=0x7f99a0007ec0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 msgr2=0x7f99b015bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009870 tx=0x7f99ac004750 comp rx=0 tx=0).stop 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 shutdown_connections 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f999406ace0 0x7f999406d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b015a5c0 0x7f99b015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b006df40 0x7f99b00b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 --2- 172.21.15.161:0/4172953690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99b0154620 0x7f99b015bc40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 >> 172.21.15.161:0/4172953690 conn(0x7f99b00cfd70 msgr2=0x7f99b015d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 shutdown_connections 2023-08-10T10:30:08.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.148+0000 7f99b8224700 1 -- 172.21.15.161:0/4172953690 wait complete. 2023-08-10T10:30:08.152 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:30:08.161 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-08-10T10:30:06.199641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":40,"acting":40,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220332,"kb_used_data":4124,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4222976,"data_stored":2389881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.164748"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446049+0000","last_change":"2023-08-10T10:30:03.466286+0000","last_active":"2023-08-10T10:30:04.446049+0000","last_peered":"2023-08-10T10:30:04.446049+0000","last_clean":"2023-08-10T10:30:04.446049+0000","last_became_active":"2023-08-10T10:30:03.466069+0000","last_became_peered":"2023-08-10T10:30:03.466069+0000","last_unstale":"2023-08-10T10:30:04.446049+0000","last_undegraded":"2023-08-10T10:30:04.446049+0000","last_fullsized":"2023-08-10T10:30:04.446049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:17.416881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445741+0000","last_change":"2023-08-10T10:30:03.465627+0000","last_active":"2023-08-10T10:30:04.445741+0000","last_peered":"2023-08-10T10:30:04.445741+0000","last_clean":"2023-08-10T10:30:04.445741+0000","last_became_active":"2023-08-10T10:30:03.465342+0000","last_became_peered":"2023-08-10T10:30:03.465342+0000","last_unstale":"2023-08-10T10:30:04.445741+0000","last_undegraded":"2023-08-10T10:30:04.445741+0000","last_fullsized":"2023-08-10T10:30:04.445741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:49:59.664067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446258+0000","last_change":"2023-08-10T10:30:03.452321+0000","last_active":"2023-08-10T10:30:04.446258+0000","last_peered":"2023-08-10T10:30:04.446258+0000","last_clean":"2023-08-10T10:30:04.446258+0000","last_became_active":"2023-08-10T10:30:03.451869+0000","last_became_peered":"2023-08-10T10:30:03.451869+0000","last_unstale":"2023-08-10T10:30:04.446258+0000","last_undegraded":"2023-08-10T10:30:04.446258+0000","last_fullsized":"2023-08-10T10:30:04.446258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:31.491111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445775+0000","last_change":"2023-08-10T10:30:03.456651+0000","last_active":"2023-08-10T10:30:04.445775+0000","last_peered":"2023-08-10T10:30:04.445775+0000","last_clean":"2023-08-10T10:30:04.445775+0000","last_became_active":"2023-08-10T10:30:03.456370+0000","last_became_peered":"2023-08-10T10:30:03.456370+0000","last_unstale":"2023-08-10T10:30:04.445775+0000","last_undegraded":"2023-08-10T10:30:04.445775+0000","last_fullsized":"2023-08-10T10:30:04.445775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:57.559110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446161+0000","last_change":"2023-08-10T10:30:03.466173+0000","last_active":"2023-08-10T10:30:04.446161+0000","last_peered":"2023-08-10T10:30:04.446161+0000","last_clean":"2023-08-10T10:30:04.446161+0000","last_became_active":"2023-08-10T10:30:03.465929+0000","last_became_peered":"2023-08-10T10:30:03.465929+0000","last_unstale":"2023-08-10T10:30:04.446161+0000","last_undegraded":"2023-08-10T10:30:04.446161+0000","last_fullsized":"2023-08-10T10:30:04.446161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:18:29.782570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446159+0000","last_change":"2023-08-10T10:30:03.058707+0000","last_active":"2023-08-10T10:30:04.446159+0000","last_peered":"2023-08-10T10:30:04.446159+0000","last_clean":"2023-08-10T10:30:04.446159+0000","last_became_active":"2023-08-10T10:30:03.058428+0000","last_became_peered":"2023-08-10T10:30:03.058428+0000","last_unstale":"2023-08-10T10:30:04.446159+0000","last_undegraded":"2023-08-10T10:30:04.446159+0000","last_fullsized":"2023-08-10T10:30:04.446159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:52.668012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446398+0000","last_change":"2023-08-10T10:30:03.455911+0000","last_active":"2023-08-10T10:30:04.446398+0000","last_peered":"2023-08-10T10:30:04.446398+0000","last_clean":"2023-08-10T10:30:04.446398+0000","last_became_active":"2023-08-10T10:30:03.455626+0000","last_became_peered":"2023-08-10T10:30:03.455626+0000","last_unstale":"2023-08-10T10:30:04.446398+0000","last_undegraded":"2023-08-10T10:30:04.446398+0000","last_fullsized":"2023-08-10T10:30:04.446398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:59.292939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445996+0000","last_change":"2023-08-10T10:30:03.050912+0000","last_active":"2023-08-10T10:30:04.445996+0000","last_peered":"2023-08-10T10:30:04.445996+0000","last_clean":"2023-08-10T10:30:04.445996+0000","last_became_active":"2023-08-10T10:30:03.050654+0000","last_became_peered":"2023-08-10T10:30:03.050654+0000","last_unstale":"2023-08-10T10:30:04.445996+0000","last_undegraded":"2023-08-10T10:30:04.445996+0000","last_fullsized":"2023-08-10T10:30:04.445996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:43.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445848+0000","last_change":"2023-08-10T10:30:03.060936+0000","last_active":"2023-08-10T10:30:04.445848+0000","last_peered":"2023-08-10T10:30:04.445848+0000","last_clean":"2023-08-10T10:30:04.445848+0000","last_became_active":"2023-08-10T10:30:03.060607+0000","last_became_peered":"2023-08-10T10:30:03.060607+0000","last_unstale":"2023-08-10T10:30:04.445848+0000","last_undegraded":"2023-08-10T10:30:04.445848+0000","last_fullsized":"2023-08-10T10:30:04.445848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:15:05.130792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445686+0000","last_change":"2023-08-10T10:30:03.052867+0000","last_active":"2023-08-10T10:30:04.445686+0000","last_peered":"2023-08-10T10:30:04.445686+0000","last_clean":"2023-08-10T10:30:04.445686+0000","last_became_active":"2023-08-10T10:30:03.052338+0000","last_became_peered":"2023-08-10T10:30:03.052338+0000","last_unstale":"2023-08-10T10:30:04.445686+0000","last_undegraded":"2023-08-10T10:30:04.445686+0000","last_fullsized":"2023-08-10T10:30:04.445686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:06.444393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613050+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:29:57.613050+0000","last_peered":"2023-08-10T10:29:57.613050+0000","last_clean":"2023-08-10T10:29:57.613050+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:29:57.613050+0000","last_undegraded":"2023-08-10T10:29:57.613050+0000","last_fullsized":"2023-08-10T10:29:57.613050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:34:25.748783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613462+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:29:57.613462+0000","last_peered":"2023-08-10T10:29:57.613462+0000","last_clean":"2023-08-10T10:29:57.613462+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:29:57.613462+0000","last_undegraded":"2023-08-10T10:29:57.613462+0000","last_fullsized":"2023-08-10T10:29:57.613462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:03.639998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446357+0000","last_change":"2023-08-10T10:30:03.055396+0000","last_active":"2023-08-10T10:30:04.446357+0000","last_peered":"2023-08-10T10:30:04.446357+0000","last_clean":"2023-08-10T10:30:04.446357+0000","last_became_active":"2023-08-10T10:30:03.055103+0000","last_became_peered":"2023-08-10T10:30:03.055103+0000","last_unstale":"2023-08-10T10:30:04.446357+0000","last_undegraded":"2023-08-10T10:30:04.446357+0000","last_fullsized":"2023-08-10T10:30:04.446357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:41.081272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445696+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:30:04.445696+0000","last_peered":"2023-08-10T10:30:04.445696+0000","last_clean":"2023-08-10T10:30:04.445696+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:30:04.445696+0000","last_undegraded":"2023-08-10T10:30:04.445696+0000","last_fullsized":"2023-08-10T10:30:04.445696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:24.570877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613465+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:29:57.613465+0000","last_peered":"2023-08-10T10:29:57.613465+0000","last_clean":"2023-08-10T10:29:57.613465+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:29:57.613465+0000","last_undegraded":"2023-08-10T10:29:57.613465+0000","last_fullsized":"2023-08-10T10:29:57.613465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:43.282380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613567+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:29:57.613567+0000","last_peered":"2023-08-10T10:29:57.613567+0000","last_clean":"2023-08-10T10:29:57.613567+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:29:57.613567+0000","last_undegraded":"2023-08-10T10:29:57.613567+0000","last_fullsized":"2023-08-10T10:29:57.613567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:22.453359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613757+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:29:57.613757+0000","last_peered":"2023-08-10T10:29:57.613757+0000","last_clean":"2023-08-10T10:29:57.613757+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:29:57.613757+0000","last_undegraded":"2023-08-10T10:29:57.613757+0000","last_fullsized":"2023-08-10T10:29:57.613757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:00.270080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613589+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:29:57.613589+0000","last_peered":"2023-08-10T10:29:57.613589+0000","last_clean":"2023-08-10T10:29:57.613589+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:29:57.613589+0000","last_undegraded":"2023-08-10T10:29:57.613589+0000","last_fullsized":"2023-08-10T10:29:57.613589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:43.282380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613159+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:29:57.613159+0000","last_peered":"2023-08-10T10:29:57.613159+0000","last_clean":"2023-08-10T10:29:57.613159+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:29:57.613159+0000","last_undegraded":"2023-08-10T10:29:57.613159+0000","last_fullsized":"2023-08-10T10:29:57.613159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:36.340712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:03.033985+0000","last_change":"2023-08-10T10:30:03.033985+0000","last_active":"2023-08-10T10:30:03.033985+0000","last_peered":"2023-08-10T10:30:03.033985+0000","last_clean":"2023-08-10T10:30:03.033985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:03.033985+0000","last_undegraded":"2023-08-10T10:30:03.033985+0000","last_fullsized":"2023-08-10T10:30:03.033985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:30:02.032217+0000","last_change":"2023-08-10T10:30:02.032217+0000","last_active":"2023-08-10T10:30:02.032217+0000","last_peered":"2023-08-10T10:30:02.032217+0000","last_clean":"2023-08-10T10:30:02.032217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:30:02.032217+0000","last_undegraded":"2023-08-10T10:30:02.032217+0000","last_fullsized":"2023-08-10T10:30:02.032217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-10T10:29:57.613245+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:29:57.613245+0000","last_peered":"2023-08-10T10:29:57.613245+0000","last_clean":"2023-08-10T10:29:57.613245+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:29:57.613245+0000","last_undegraded":"2023-08-10T10:29:57.613245+0000","last_fullsized":"2023-08-10T10:29:57.613245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:55:09.140656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":147812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.308},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.379}]},{"osd":4,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.432},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.46300000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":738180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.8609999999999998,"5min":5.8609999999999998,"15min":5.8609999999999998},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":6.915,"5min":6.915,"15min":6.915},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.9139999999999997,"5min":5.9139999999999997,"15min":5.9139999999999997},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.2640000000000002,"5min":4.2640000000000002,"15min":4.2640000000000002},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.498}]},{"osd":6,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":174461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.309}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.375}]},{"osd":3,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.437},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.623},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.963000000000001,"5min":21.963000000000001,"15min":21.963000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.747}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":966656,"data_stored":738180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":9.5990000000000002,"5min":9.5990000000000002,"15min":9.5990000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":13.677,"5min":13.677,"15min":13.677},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":13.708,"5min":13.708,"15min":13.708},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.252}]},{"osd":3,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":13.602,"5min":13.602,"15min":13.602},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.4649999999999999,"5min":5.4649999999999999,"15min":5.4649999999999999},"last":0.373},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":13.644,"5min":13.644,"15min":13.644},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.5229999999999997,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":13.515000000000001,"5min":13.515000000000001,"15min":13.515000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.501}]},{"osd":7,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":147812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.497}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.435},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":372736,"data_stored":147812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.439}]},{"osd":2,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":147812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.505}]},{"osd":2,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":147812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.629}]},{"osd":3,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:30:08.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:30:08.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.320+0000 7fe786feb700 1 Processor -- start 2023-08-10T10:30:08.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 -- start start 2023-08-10T10:30:08.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe7800d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7800cdef0 0x7fe7800c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800cc780 con 0x7fe7800d1a40 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800ccd40 con 0x7fe7800cdef0 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.321+0000 7fe786feb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800cca60 con 0x7fe78015b050 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77ffff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe7800d1a40 0x7fe7800cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38966/0 (socket says 172.21.15.161:38966) 2023-08-10T10:30:08.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77ffff700 1 -- 172.21.15.161:0/2637534402 learned_addr learned my addr 172.21.15.161:0/2637534402 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe785588700 1 --2- 172.21.15.161:0/2637534402 >> v2:172.21.15.175:3300/0 conn(0x7fe7800cdef0 0x7fe7800c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe784d87700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe7800d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902886326 0 0) 0x7fe7800cc780 con 0x7fe7800d1a40 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7700035b0 con 0x7fe7800d1a40 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990330385 0 0) 0x7fe7700035b0 con 0x7fe7800d1a40 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 msgr2=0x7fe7800d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe7800d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 >> v2:172.21.15.175:3300/0 conn(0x7fe7800cdef0 msgr2=0x7fe7800c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 --2- 172.21.15.161:0/2637534402 >> v2:172.21.15.175:3300/0 conn(0x7fe7800cdef0 0x7fe7800c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800c4ae0 con 0x7fe7800d1a40 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fe76c001670 con 0x7fe7800d1a40 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 >> v1:172.21.15.161:6789/0 conn(0x7fe7800d1a40 legacy=0x7fe7800cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe770003a00 0x7fe770003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe770004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe770005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800ccd40 con 0x7fe770004850 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800cca60 con 0x7fe770003a00 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77000ba10 con 0x7fe78015b050 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe77ffff700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe770004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe784d87700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe770003a00 0x7fe770003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.322+0000 7fe785588700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe770005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 -- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 msgr2=0x7fe770005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe770005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 -- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe770003a00 msgr2=0x7fe770003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe770003a00 0x7fe770003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 -- 172.21.15.161:0/2637534402 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700035b0 con 0x7fe770004850 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe785588700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78015b050 0x7fe770005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77ffff700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe770004cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c370 tx=0x7fe770005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4db907c8285e1d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c007c60 con 0x7fe770004850 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c005960 con 0x7fe770004850 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe77f7fe700 1 -- 172.21.15.161:0/2637534402 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c005d10 con 0x7fe770004850 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 -- 172.21.15.161:0/2637534402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 msgr2=0x7fe770004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 --2- 172.21.15.161:0/2637534402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe770004cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c370 tx=0x7fe770005880 comp rx=0 tx=0).stop 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe785588700 1 -- 172.21.15.161:0/2637534402 reap_dead start 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 -- 172.21.15.161:0/2637534402 shutdown_connections 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 -- 172.21.15.161:0/2637534402 >> 172.21.15.161:0/2637534402 conn(0x7fe78009a150 msgr2=0x7fe7800d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 -- 172.21.15.161:0/2637534402 shutdown_connections 2023-08-10T10:30:08.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.323+0000 7fe786feb700 1 -- 172.21.15.161:0/2637534402 wait complete. 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.325+0000 7fe786feb700 1 Processor -- start 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.325+0000 7fe786feb700 1 -- start start 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe780158fd0 0x7fe780150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7801598f0 0x7fe780159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78015a2b0 con 0x7fe770004850 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78006b3d0 con 0x7fe7801598f0 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe780159450 con 0x7fe780158fd0 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33740/0 (socket says 172.21.15.161:33740) 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 -- 172.21.15.161:0/766390377 learned_addr learned my addr 172.21.15.161:0/766390377 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe77ffff700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe780158fd0 0x7fe780150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe785588700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7801598f0 0x7fe780159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 -- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe780158fd0 msgr2=0x7fe780150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe780158fd0 0x7fe780150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 -- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7801598f0 msgr2=0x7fe780159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7801598f0 0x7fe780159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 -- 172.21.15.161:0/766390377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780150bc0 con 0x7fe770004850 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe784d87700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7740119d0 tx=0x7fe774011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774005c30 con 0x7fe770004850 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774005d90 con 0x7fe770004850 2023-08-10T10:30:08.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe780158420 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400f910 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.326+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe780157e60 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.327+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78006b6b0 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.328+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe77400fa70 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.328+0000 7fe77d7fa700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 0x7fe76406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.328+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe774089a20 con 0x7fe770004850 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.328+0000 7fe77ffff700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 0x7fe76406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.328+0000 7fe77ffff700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 0x7fe76406d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe78006e320 tx=0x7fe76c00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.332+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe774054ad0 con 0x7fe770004850 2023-08-10T10:30:08.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.519+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 --> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7800c4dc0 con 0x7fe76406ace0 2023-08-10T10:30:08.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.527+0000 7fe77d7fa700 1 -- 172.21.15.161:0/766390377 <== mgr.4104 v2:172.21.15.161:6832/4243192540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311342 (secure 0 0 0) 0x7fe76c023070 con 0x7fe76406ace0 2023-08-10T10:30:08.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 msgr2=0x7fe76406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 0x7fe76406d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe78006e320 tx=0x7fe76c00a000 comp rx=0 tx=0).stop 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 msgr2=0x7fe7801574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7740119d0 tx=0x7fe774011ce0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 shutdown_connections 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe76406ace0 0x7fe76406d1a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7801598f0 0x7fe780159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe770004850 0x7fe7801574a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 --2- 172.21.15.161:0/766390377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe780158fd0 0x7fe780150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.530+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 >> 172.21.15.161:0/766390377 conn(0x7fe78009a150 msgr2=0x7fe7800c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.531+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 shutdown_connections 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.531+0000 7fe786feb700 1 -- 172.21.15.161:0/766390377 wait complete. 2023-08-10T10:30:08.534 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-08-10T10:30:08.544 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-08-10T10:30:08.200105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220692,"kb_used_data":4520,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754028,"statfs":{"total":773094113280,"available":772868124672,"internally_reserved":0,"allocated":4628480,"data_stored":2580588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001096"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457754+0000","last_change":"2023-08-10T10:30:03.455470+0000","last_active":"2023-08-10T10:30:04.457754+0000","last_peered":"2023-08-10T10:30:04.457754+0000","last_clean":"2023-08-10T10:30:04.457754+0000","last_became_active":"2023-08-10T10:30:03.455144+0000","last_became_peered":"2023-08-10T10:30:03.455144+0000","last_unstale":"2023-08-10T10:30:04.457754+0000","last_undegraded":"2023-08-10T10:30:04.457754+0000","last_fullsized":"2023-08-10T10:30:04.457754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:17:18.613747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457270+0000","last_change":"2023-08-10T10:30:03.453887+0000","last_active":"2023-08-10T10:30:04.457270+0000","last_peered":"2023-08-10T10:30:04.457270+0000","last_clean":"2023-08-10T10:30:04.457270+0000","last_became_active":"2023-08-10T10:30:03.453619+0000","last_became_peered":"2023-08-10T10:30:03.453619+0000","last_unstale":"2023-08-10T10:30:04.457270+0000","last_undegraded":"2023-08-10T10:30:04.457270+0000","last_fullsized":"2023-08-10T10:30:04.457270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:42:53.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457116+0000","last_change":"2023-08-10T10:30:03.463443+0000","last_active":"2023-08-10T10:30:04.457116+0000","last_peered":"2023-08-10T10:30:04.457116+0000","last_clean":"2023-08-10T10:30:04.457116+0000","last_became_active":"2023-08-10T10:30:03.463168+0000","last_became_peered":"2023-08-10T10:30:03.463168+0000","last_unstale":"2023-08-10T10:30:04.457116+0000","last_undegraded":"2023-08-10T10:30:04.457116+0000","last_fullsized":"2023-08-10T10:30:04.457116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:58.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446049+0000","last_change":"2023-08-10T10:30:03.466286+0000","last_active":"2023-08-10T10:30:04.446049+0000","last_peered":"2023-08-10T10:30:04.446049+0000","last_clean":"2023-08-10T10:30:04.446049+0000","last_became_active":"2023-08-10T10:30:03.466069+0000","last_became_peered":"2023-08-10T10:30:03.466069+0000","last_unstale":"2023-08-10T10:30:04.446049+0000","last_undegraded":"2023-08-10T10:30:04.446049+0000","last_fullsized":"2023-08-10T10:30:04.446049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:17.416881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445741+0000","last_change":"2023-08-10T10:30:03.465627+0000","last_active":"2023-08-10T10:30:04.445741+0000","last_peered":"2023-08-10T10:30:04.445741+0000","last_clean":"2023-08-10T10:30:04.445741+0000","last_became_active":"2023-08-10T10:30:03.465342+0000","last_became_peered":"2023-08-10T10:30:03.465342+0000","last_unstale":"2023-08-10T10:30:04.445741+0000","last_undegraded":"2023-08-10T10:30:04.445741+0000","last_fullsized":"2023-08-10T10:30:04.445741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:49:59.664067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457880+0000","last_change":"2023-08-10T10:30:03.454195+0000","last_active":"2023-08-10T10:30:04.457880+0000","last_peered":"2023-08-10T10:30:04.457880+0000","last_clean":"2023-08-10T10:30:04.457880+0000","last_became_active":"2023-08-10T10:30:03.453939+0000","last_became_peered":"2023-08-10T10:30:03.453939+0000","last_unstale":"2023-08-10T10:30:04.457880+0000","last_undegraded":"2023-08-10T10:30:04.457880+0000","last_fullsized":"2023-08-10T10:30:04.457880+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:33.003568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458181+0000","last_change":"2023-08-10T10:30:03.461831+0000","last_active":"2023-08-10T10:30:04.458181+0000","last_peered":"2023-08-10T10:30:04.458181+0000","last_clean":"2023-08-10T10:30:04.458181+0000","last_became_active":"2023-08-10T10:30:03.461545+0000","last_became_peered":"2023-08-10T10:30:03.461545+0000","last_unstale":"2023-08-10T10:30:04.458181+0000","last_undegraded":"2023-08-10T10:30:04.458181+0000","last_fullsized":"2023-08-10T10:30:04.458181+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:07.396952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457004+0000","last_change":"2023-08-10T10:30:03.461191+0000","last_active":"2023-08-10T10:30:04.457004+0000","last_peered":"2023-08-10T10:30:04.457004+0000","last_clean":"2023-08-10T10:30:04.457004+0000","last_became_active":"2023-08-10T10:30:03.460871+0000","last_became_peered":"2023-08-10T10:30:03.460871+0000","last_unstale":"2023-08-10T10:30:04.457004+0000","last_undegraded":"2023-08-10T10:30:04.457004+0000","last_fullsized":"2023-08-10T10:30:04.457004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:32.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457541+0000","last_change":"2023-08-10T10:30:03.461011+0000","last_active":"2023-08-10T10:30:04.457541+0000","last_peered":"2023-08-10T10:30:04.457541+0000","last_clean":"2023-08-10T10:30:04.457541+0000","last_became_active":"2023-08-10T10:30:03.460723+0000","last_became_peered":"2023-08-10T10:30:03.460723+0000","last_unstale":"2023-08-10T10:30:04.457541+0000","last_undegraded":"2023-08-10T10:30:04.457541+0000","last_fullsized":"2023-08-10T10:30:04.457541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:42:53.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457838+0000","last_change":"2023-08-10T10:30:03.467510+0000","last_active":"2023-08-10T10:30:04.457838+0000","last_peered":"2023-08-10T10:30:04.457838+0000","last_clean":"2023-08-10T10:30:04.457838+0000","last_became_active":"2023-08-10T10:30:03.467211+0000","last_became_peered":"2023-08-10T10:30:03.467211+0000","last_unstale":"2023-08-10T10:30:04.457838+0000","last_undegraded":"2023-08-10T10:30:04.457838+0000","last_fullsized":"2023-08-10T10:30:04.457838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:40.237929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458319+0000","last_change":"2023-08-10T10:30:03.469940+0000","last_active":"2023-08-10T10:30:04.458319+0000","last_peered":"2023-08-10T10:30:04.458319+0000","last_clean":"2023-08-10T10:30:04.458319+0000","last_became_active":"2023-08-10T10:30:03.469608+0000","last_became_peered":"2023-08-10T10:30:03.469608+0000","last_unstale":"2023-08-10T10:30:04.458319+0000","last_undegraded":"2023-08-10T10:30:04.458319+0000","last_fullsized":"2023-08-10T10:30:04.458319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:33:17.695271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457884+0000","last_change":"2023-08-10T10:30:03.452979+0000","last_active":"2023-08-10T10:30:04.457884+0000","last_peered":"2023-08-10T10:30:04.457884+0000","last_clean":"2023-08-10T10:30:04.457884+0000","last_became_active":"2023-08-10T10:30:03.452712+0000","last_became_peered":"2023-08-10T10:30:03.452712+0000","last_unstale":"2023-08-10T10:30:04.457884+0000","last_undegraded":"2023-08-10T10:30:04.457884+0000","last_fullsized":"2023-08-10T10:30:04.457884+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:59:45.542297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457263+0000","last_change":"2023-08-10T10:30:03.467586+0000","last_active":"2023-08-10T10:30:04.457263+0000","last_peered":"2023-08-10T10:30:04.457263+0000","last_clean":"2023-08-10T10:30:04.457263+0000","last_became_active":"2023-08-10T10:30:03.467278+0000","last_became_peered":"2023-08-10T10:30:03.467278+0000","last_unstale":"2023-08-10T10:30:04.457263+0000","last_undegraded":"2023-08-10T10:30:04.457263+0000","last_fullsized":"2023-08-10T10:30:04.457263+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:51.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447691+0000","last_change":"2023-08-10T10:30:03.465173+0000","last_active":"2023-08-10T10:30:04.447691+0000","last_peered":"2023-08-10T10:30:04.447691+0000","last_clean":"2023-08-10T10:30:04.447691+0000","last_became_active":"2023-08-10T10:30:03.464893+0000","last_became_peered":"2023-08-10T10:30:03.464893+0000","last_unstale":"2023-08-10T10:30:04.447691+0000","last_undegraded":"2023-08-10T10:30:04.447691+0000","last_fullsized":"2023-08-10T10:30:04.447691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:12.209653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457792+0000","last_change":"2023-08-10T10:30:03.461769+0000","last_active":"2023-08-10T10:30:04.457792+0000","last_peered":"2023-08-10T10:30:04.457792+0000","last_clean":"2023-08-10T10:30:04.457792+0000","last_became_active":"2023-08-10T10:30:03.461182+0000","last_became_peered":"2023-08-10T10:30:03.461182+0000","last_unstale":"2023-08-10T10:30:04.457792+0000","last_undegraded":"2023-08-10T10:30:04.457792+0000","last_fullsized":"2023-08-10T10:30:04.457792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:00.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458464+0000","last_change":"2023-08-10T10:30:03.461986+0000","last_active":"2023-08-10T10:30:04.458464+0000","last_peered":"2023-08-10T10:30:04.458464+0000","last_clean":"2023-08-10T10:30:04.458464+0000","last_became_active":"2023-08-10T10:30:03.461713+0000","last_became_peered":"2023-08-10T10:30:03.461713+0000","last_unstale":"2023-08-10T10:30:04.458464+0000","last_undegraded":"2023-08-10T10:30:04.458464+0000","last_fullsized":"2023-08-10T10:30:04.458464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:59.810015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458181+0000","last_change":"2023-08-10T10:30:03.461448+0000","last_active":"2023-08-10T10:30:04.458181+0000","last_peered":"2023-08-10T10:30:04.458181+0000","last_clean":"2023-08-10T10:30:04.458181+0000","last_became_active":"2023-08-10T10:30:03.461143+0000","last_became_peered":"2023-08-10T10:30:03.461143+0000","last_unstale":"2023-08-10T10:30:04.458181+0000","last_undegraded":"2023-08-10T10:30:04.458181+0000","last_fullsized":"2023-08-10T10:30:04.458181+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:11:14.354189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457909+0000","last_change":"2023-08-10T10:30:03.458135+0000","last_active":"2023-08-10T10:30:04.457909+0000","last_peered":"2023-08-10T10:30:04.457909+0000","last_clean":"2023-08-10T10:30:04.457909+0000","last_became_active":"2023-08-10T10:30:03.457875+0000","last_became_peered":"2023-08-10T10:30:03.457875+0000","last_unstale":"2023-08-10T10:30:04.457909+0000","last_undegraded":"2023-08-10T10:30:04.457909+0000","last_fullsized":"2023-08-10T10:30:04.457909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:42.083040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446258+0000","last_change":"2023-08-10T10:30:03.452321+0000","last_active":"2023-08-10T10:30:04.446258+0000","last_peered":"2023-08-10T10:30:04.446258+0000","last_clean":"2023-08-10T10:30:04.446258+0000","last_became_active":"2023-08-10T10:30:03.451869+0000","last_became_peered":"2023-08-10T10:30:03.451869+0000","last_unstale":"2023-08-10T10:30:04.446258+0000","last_undegraded":"2023-08-10T10:30:04.446258+0000","last_fullsized":"2023-08-10T10:30:04.446258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:31.491111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457857+0000","last_change":"2023-08-10T10:30:03.469086+0000","last_active":"2023-08-10T10:30:04.457857+0000","last_peered":"2023-08-10T10:30:04.457857+0000","last_clean":"2023-08-10T10:30:04.457857+0000","last_became_active":"2023-08-10T10:30:03.468805+0000","last_became_peered":"2023-08-10T10:30:03.468805+0000","last_unstale":"2023-08-10T10:30:04.457857+0000","last_undegraded":"2023-08-10T10:30:04.457857+0000","last_fullsized":"2023-08-10T10:30:04.457857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:31.491111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457418+0000","last_change":"2023-08-10T10:30:03.461321+0000","last_active":"2023-08-10T10:30:04.457418+0000","last_peered":"2023-08-10T10:30:04.457418+0000","last_clean":"2023-08-10T10:30:04.457418+0000","last_became_active":"2023-08-10T10:30:03.461015+0000","last_became_peered":"2023-08-10T10:30:03.461015+0000","last_unstale":"2023-08-10T10:30:04.457418+0000","last_undegraded":"2023-08-10T10:30:04.457418+0000","last_fullsized":"2023-08-10T10:30:04.457418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:30.981739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447324+0000","last_change":"2023-08-10T10:30:03.467556+0000","last_active":"2023-08-10T10:30:04.447324+0000","last_peered":"2023-08-10T10:30:04.447324+0000","last_clean":"2023-08-10T10:30:04.447324+0000","last_became_active":"2023-08-10T10:30:03.467295+0000","last_became_peered":"2023-08-10T10:30:03.467295+0000","last_unstale":"2023-08-10T10:30:04.447324+0000","last_undegraded":"2023-08-10T10:30:04.447324+0000","last_fullsized":"2023-08-10T10:30:04.447324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:12.370440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457897+0000","last_change":"2023-08-10T10:30:03.457439+0000","last_active":"2023-08-10T10:30:04.457897+0000","last_peered":"2023-08-10T10:30:04.457897+0000","last_clean":"2023-08-10T10:30:04.457897+0000","last_became_active":"2023-08-10T10:30:03.457119+0000","last_became_peered":"2023-08-10T10:30:03.457119+0000","last_unstale":"2023-08-10T10:30:04.457897+0000","last_undegraded":"2023-08-10T10:30:04.457897+0000","last_fullsized":"2023-08-10T10:30:04.457897+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:34.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445775+0000","last_change":"2023-08-10T10:30:03.456651+0000","last_active":"2023-08-10T10:30:04.445775+0000","last_peered":"2023-08-10T10:30:04.445775+0000","last_clean":"2023-08-10T10:30:04.445775+0000","last_became_active":"2023-08-10T10:30:03.456370+0000","last_became_peered":"2023-08-10T10:30:03.456370+0000","last_unstale":"2023-08-10T10:30:04.445775+0000","last_undegraded":"2023-08-10T10:30:04.445775+0000","last_fullsized":"2023-08-10T10:30:04.445775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:57.559110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458446+0000","last_change":"2023-08-10T10:30:03.455600+0000","last_active":"2023-08-10T10:30:04.458446+0000","last_peered":"2023-08-10T10:30:04.458446+0000","last_clean":"2023-08-10T10:30:04.458446+0000","last_became_active":"2023-08-10T10:30:03.455315+0000","last_became_peered":"2023-08-10T10:30:03.455315+0000","last_unstale":"2023-08-10T10:30:04.458446+0000","last_undegraded":"2023-08-10T10:30:04.458446+0000","last_fullsized":"2023-08-10T10:30:04.458446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:55.079125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458120+0000","last_change":"2023-08-10T10:30:03.463664+0000","last_active":"2023-08-10T10:30:04.458120+0000","last_peered":"2023-08-10T10:30:04.458120+0000","last_clean":"2023-08-10T10:30:04.458120+0000","last_became_active":"2023-08-10T10:30:03.463417+0000","last_became_peered":"2023-08-10T10:30:03.463417+0000","last_unstale":"2023-08-10T10:30:04.458120+0000","last_undegraded":"2023-08-10T10:30:04.458120+0000","last_fullsized":"2023-08-10T10:30:04.458120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:09:44.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458009+0000","last_change":"2023-08-10T10:30:03.453438+0000","last_active":"2023-08-10T10:30:04.458009+0000","last_peered":"2023-08-10T10:30:04.458009+0000","last_clean":"2023-08-10T10:30:04.458009+0000","last_became_active":"2023-08-10T10:30:03.453116+0000","last_became_peered":"2023-08-10T10:30:03.453116+0000","last_unstale":"2023-08-10T10:30:04.458009+0000","last_undegraded":"2023-08-10T10:30:04.458009+0000","last_fullsized":"2023-08-10T10:30:04.458009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:31:54.209943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457271+0000","last_change":"2023-08-10T10:30:03.461230+0000","last_active":"2023-08-10T10:30:04.457271+0000","last_peered":"2023-08-10T10:30:04.457271+0000","last_clean":"2023-08-10T10:30:04.457271+0000","last_became_active":"2023-08-10T10:30:03.460882+0000","last_became_peered":"2023-08-10T10:30:03.460882+0000","last_unstale":"2023-08-10T10:30:04.457271+0000","last_undegraded":"2023-08-10T10:30:04.457271+0000","last_fullsized":"2023-08-10T10:30:04.457271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:44.516424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458389+0000","last_change":"2023-08-10T10:30:03.455722+0000","last_active":"2023-08-10T10:30:04.458389+0000","last_peered":"2023-08-10T10:30:04.458389+0000","last_clean":"2023-08-10T10:30:04.458389+0000","last_became_active":"2023-08-10T10:30:03.455294+0000","last_became_peered":"2023-08-10T10:30:03.455294+0000","last_unstale":"2023-08-10T10:30:04.458389+0000","last_undegraded":"2023-08-10T10:30:04.458389+0000","last_fullsized":"2023-08-10T10:30:04.458389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:53.932019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457626+0000","last_change":"2023-08-10T10:30:03.454697+0000","last_active":"2023-08-10T10:30:04.457626+0000","last_peered":"2023-08-10T10:30:04.457626+0000","last_clean":"2023-08-10T10:30:04.457626+0000","last_became_active":"2023-08-10T10:30:03.454397+0000","last_became_peered":"2023-08-10T10:30:03.454397+0000","last_unstale":"2023-08-10T10:30:04.457626+0000","last_undegraded":"2023-08-10T10:30:04.457626+0000","last_fullsized":"2023-08-10T10:30:04.457626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:18:29.782570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457749+0000","last_change":"2023-08-10T10:30:03.459605+0000","last_active":"2023-08-10T10:30:04.457749+0000","last_peered":"2023-08-10T10:30:04.457749+0000","last_clean":"2023-08-10T10:30:04.457749+0000","last_became_active":"2023-08-10T10:30:03.459132+0000","last_became_peered":"2023-08-10T10:30:03.459132+0000","last_unstale":"2023-08-10T10:30:04.457749+0000","last_undegraded":"2023-08-10T10:30:04.457749+0000","last_fullsized":"2023-08-10T10:30:04.457749+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:16.354597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457388+0000","last_change":"2023-08-10T10:30:03.452894+0000","last_active":"2023-08-10T10:30:04.457388+0000","last_peered":"2023-08-10T10:30:04.457388+0000","last_clean":"2023-08-10T10:30:04.457388+0000","last_became_active":"2023-08-10T10:30:03.452609+0000","last_became_peered":"2023-08-10T10:30:03.452609+0000","last_unstale":"2023-08-10T10:30:04.457388+0000","last_undegraded":"2023-08-10T10:30:04.457388+0000","last_fullsized":"2023-08-10T10:30:04.457388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:42.105554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458330+0000","last_change":"2023-08-10T10:30:03.461942+0000","last_active":"2023-08-10T10:30:04.458330+0000","last_peered":"2023-08-10T10:30:04.458330+0000","last_clean":"2023-08-10T10:30:04.458330+0000","last_became_active":"2023-08-10T10:30:03.461674+0000","last_became_peered":"2023-08-10T10:30:03.461674+0000","last_unstale":"2023-08-10T10:30:04.458330+0000","last_undegraded":"2023-08-10T10:30:04.458330+0000","last_fullsized":"2023-08-10T10:30:04.458330+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:22.412904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458557+0000","last_change":"2023-08-10T10:30:03.061159+0000","last_active":"2023-08-10T10:30:04.458557+0000","last_peered":"2023-08-10T10:30:04.458557+0000","last_clean":"2023-08-10T10:30:04.458557+0000","last_became_active":"2023-08-10T10:30:03.060901+0000","last_became_peered":"2023-08-10T10:30:03.060901+0000","last_unstale":"2023-08-10T10:30:04.458557+0000","last_undegraded":"2023-08-10T10:30:04.458557+0000","last_fullsized":"2023-08-10T10:30:04.458557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:12.043030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458229+0000","last_change":"2023-08-10T10:30:03.465289+0000","last_active":"2023-08-10T10:30:04.458229+0000","last_peered":"2023-08-10T10:30:04.458229+0000","last_clean":"2023-08-10T10:30:04.458229+0000","last_became_active":"2023-08-10T10:30:03.465022+0000","last_became_peered":"2023-08-10T10:30:03.465022+0000","last_unstale":"2023-08-10T10:30:04.458229+0000","last_undegraded":"2023-08-10T10:30:04.458229+0000","last_fullsized":"2023-08-10T10:30:04.458229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:40.846839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457437+0000","last_change":"2023-08-10T10:30:03.058185+0000","last_active":"2023-08-10T10:30:04.457437+0000","last_peered":"2023-08-10T10:30:04.457437+0000","last_clean":"2023-08-10T10:30:04.457437+0000","last_became_active":"2023-08-10T10:30:03.057877+0000","last_became_peered":"2023-08-10T10:30:03.057877+0000","last_unstale":"2023-08-10T10:30:04.457437+0000","last_undegraded":"2023-08-10T10:30:04.457437+0000","last_fullsized":"2023-08-10T10:30:04.457437+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:27.033666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447604+0000","last_change":"2023-08-10T10:30:03.465515+0000","last_active":"2023-08-10T10:30:04.447604+0000","last_peered":"2023-08-10T10:30:04.447604+0000","last_clean":"2023-08-10T10:30:04.447604+0000","last_became_active":"2023-08-10T10:30:03.465246+0000","last_became_peered":"2023-08-10T10:30:03.465246+0000","last_unstale":"2023-08-10T10:30:04.447604+0000","last_undegraded":"2023-08-10T10:30:04.447604+0000","last_fullsized":"2023-08-10T10:30:04.447604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:42.696740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458284+0000","last_change":"2023-08-10T10:30:03.059188+0000","last_active":"2023-08-10T10:30:04.458284+0000","last_peered":"2023-08-10T10:30:04.458284+0000","last_clean":"2023-08-10T10:30:04.458284+0000","last_became_active":"2023-08-10T10:30:03.058928+0000","last_became_peered":"2023-08-10T10:30:03.058928+0000","last_unstale":"2023-08-10T10:30:04.458284+0000","last_undegraded":"2023-08-10T10:30:04.458284+0000","last_fullsized":"2023-08-10T10:30:04.458284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:57.314604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457780+0000","last_change":"2023-08-10T10:30:03.457545+0000","last_active":"2023-08-10T10:30:04.457780+0000","last_peered":"2023-08-10T10:30:04.457780+0000","last_clean":"2023-08-10T10:30:04.457780+0000","last_became_active":"2023-08-10T10:30:03.456892+0000","last_became_peered":"2023-08-10T10:30:03.456892+0000","last_unstale":"2023-08-10T10:30:04.457780+0000","last_undegraded":"2023-08-10T10:30:04.457780+0000","last_fullsized":"2023-08-10T10:30:04.457780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:23.993762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447761+0000","last_change":"2023-08-10T10:30:03.058580+0000","last_active":"2023-08-10T10:30:04.447761+0000","last_peered":"2023-08-10T10:30:04.447761+0000","last_clean":"2023-08-10T10:30:04.447761+0000","last_became_active":"2023-08-10T10:30:03.058120+0000","last_became_peered":"2023-08-10T10:30:03.058120+0000","last_unstale":"2023-08-10T10:30:04.447761+0000","last_undegraded":"2023-08-10T10:30:04.447761+0000","last_fullsized":"2023-08-10T10:30:04.447761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:57:34.674073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.456772+0000","last_change":"2023-08-10T10:30:03.457148+0000","last_active":"2023-08-10T10:30:04.456772+0000","last_peered":"2023-08-10T10:30:04.456772+0000","last_clean":"2023-08-10T10:30:04.456772+0000","last_became_active":"2023-08-10T10:30:03.456900+0000","last_became_peered":"2023-08-10T10:30:03.456900+0000","last_unstale":"2023-08-10T10:30:04.456772+0000","last_undegraded":"2023-08-10T10:30:04.456772+0000","last_fullsized":"2023-08-10T10:30:04.456772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:09:44.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457699+0000","last_change":"2023-08-10T10:30:03.053328+0000","last_active":"2023-08-10T10:30:04.457699+0000","last_peered":"2023-08-10T10:30:04.457699+0000","last_clean":"2023-08-10T10:30:04.457699+0000","last_became_active":"2023-08-10T10:30:03.053046+0000","last_became_peered":"2023-08-10T10:30:03.053046+0000","last_unstale":"2023-08-10T10:30:04.457699+0000","last_undegraded":"2023-08-10T10:30:04.457699+0000","last_fullsized":"2023-08-10T10:30:04.457699+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:33.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457990+0000","last_change":"2023-08-10T10:30:03.461592+0000","last_active":"2023-08-10T10:30:04.457990+0000","last_peered":"2023-08-10T10:30:04.457990+0000","last_clean":"2023-08-10T10:30:04.457990+0000","last_became_active":"2023-08-10T10:30:03.460527+0000","last_became_peered":"2023-08-10T10:30:03.460527+0000","last_unstale":"2023-08-10T10:30:04.457990+0000","last_undegraded":"2023-08-10T10:30:04.457990+0000","last_fullsized":"2023-08-10T10:30:04.457990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:11:14.354189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458276+0000","last_change":"2023-08-10T10:30:03.062234+0000","last_active":"2023-08-10T10:30:04.458276+0000","last_peered":"2023-08-10T10:30:04.458276+0000","last_clean":"2023-08-10T10:30:04.458276+0000","last_became_active":"2023-08-10T10:30:03.061263+0000","last_became_peered":"2023-08-10T10:30:03.061263+0000","last_unstale":"2023-08-10T10:30:04.458276+0000","last_undegraded":"2023-08-10T10:30:04.458276+0000","last_fullsized":"2023-08-10T10:30:04.458276+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:53:29.979970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447366+0000","last_change":"2023-08-10T10:30:03.469228+0000","last_active":"2023-08-10T10:30:04.447366+0000","last_peered":"2023-08-10T10:30:04.447366+0000","last_clean":"2023-08-10T10:30:04.447366+0000","last_became_active":"2023-08-10T10:30:03.468849+0000","last_became_peered":"2023-08-10T10:30:03.468849+0000","last_unstale":"2023-08-10T10:30:04.447366+0000","last_undegraded":"2023-08-10T10:30:04.447366+0000","last_fullsized":"2023-08-10T10:30:04.447366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:33:17.695271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457706+0000","last_change":"2023-08-10T10:30:03.056310+0000","last_active":"2023-08-10T10:30:04.457706+0000","last_peered":"2023-08-10T10:30:04.457706+0000","last_clean":"2023-08-10T10:30:04.457706+0000","last_became_active":"2023-08-10T10:30:03.055981+0000","last_became_peered":"2023-08-10T10:30:03.055981+0000","last_unstale":"2023-08-10T10:30:04.457706+0000","last_undegraded":"2023-08-10T10:30:04.457706+0000","last_fullsized":"2023-08-10T10:30:04.457706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:34:16.564022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457621+0000","last_change":"2023-08-10T10:30:03.459555+0000","last_active":"2023-08-10T10:30:04.457621+0000","last_peered":"2023-08-10T10:30:04.457621+0000","last_clean":"2023-08-10T10:30:04.457621+0000","last_became_active":"2023-08-10T10:30:03.459288+0000","last_became_peered":"2023-08-10T10:30:03.459288+0000","last_unstale":"2023-08-10T10:30:04.457621+0000","last_undegraded":"2023-08-10T10:30:04.457621+0000","last_fullsized":"2023-08-10T10:30:04.457621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:46:21.015359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447207+0000","last_change":"2023-08-10T10:30:03.057978+0000","last_active":"2023-08-10T10:30:04.447207+0000","last_peered":"2023-08-10T10:30:04.447207+0000","last_clean":"2023-08-10T10:30:04.447207+0000","last_became_active":"2023-08-10T10:30:03.057636+0000","last_became_peered":"2023-08-10T10:30:03.057636+0000","last_unstale":"2023-08-10T10:30:04.447207+0000","last_undegraded":"2023-08-10T10:30:04.447207+0000","last_fullsized":"2023-08-10T10:30:04.447207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:06.395184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446161+0000","last_change":"2023-08-10T10:30:03.466173+0000","last_active":"2023-08-10T10:30:04.446161+0000","last_peered":"2023-08-10T10:30:04.446161+0000","last_clean":"2023-08-10T10:30:04.446161+0000","last_became_active":"2023-08-10T10:30:03.465929+0000","last_became_peered":"2023-08-10T10:30:03.465929+0000","last_unstale":"2023-08-10T10:30:04.446161+0000","last_undegraded":"2023-08-10T10:30:04.446161+0000","last_fullsized":"2023-08-10T10:30:04.446161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:18:29.782570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457862+0000","last_change":"2023-08-10T10:30:03.056509+0000","last_active":"2023-08-10T10:30:04.457862+0000","last_peered":"2023-08-10T10:30:04.457862+0000","last_clean":"2023-08-10T10:30:04.457862+0000","last_became_active":"2023-08-10T10:30:03.056230+0000","last_became_peered":"2023-08-10T10:30:03.056230+0000","last_unstale":"2023-08-10T10:30:04.457862+0000","last_undegraded":"2023-08-10T10:30:04.457862+0000","last_fullsized":"2023-08-10T10:30:04.457862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:09:00.980720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457974+0000","last_change":"2023-08-10T10:30:03.458106+0000","last_active":"2023-08-10T10:30:04.457974+0000","last_peered":"2023-08-10T10:30:04.457974+0000","last_clean":"2023-08-10T10:30:04.457974+0000","last_became_active":"2023-08-10T10:30:03.457839+0000","last_became_peered":"2023-08-10T10:30:03.457839+0000","last_unstale":"2023-08-10T10:30:04.457974+0000","last_undegraded":"2023-08-10T10:30:04.457974+0000","last_fullsized":"2023-08-10T10:30:04.457974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:00.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457952+0000","last_change":"2023-08-10T10:30:03.056504+0000","last_active":"2023-08-10T10:30:04.457952+0000","last_peered":"2023-08-10T10:30:04.457952+0000","last_clean":"2023-08-10T10:30:04.457952+0000","last_became_active":"2023-08-10T10:30:03.056225+0000","last_became_peered":"2023-08-10T10:30:03.056225+0000","last_unstale":"2023-08-10T10:30:04.457952+0000","last_undegraded":"2023-08-10T10:30:04.457952+0000","last_fullsized":"2023-08-10T10:30:04.457952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:58.309694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457324+0000","last_change":"2023-08-10T10:30:03.456441+0000","last_active":"2023-08-10T10:30:04.457324+0000","last_peered":"2023-08-10T10:30:04.457324+0000","last_clean":"2023-08-10T10:30:04.457324+0000","last_became_active":"2023-08-10T10:30:03.456167+0000","last_became_peered":"2023-08-10T10:30:03.456167+0000","last_unstale":"2023-08-10T10:30:04.457324+0000","last_undegraded":"2023-08-10T10:30:04.457324+0000","last_fullsized":"2023-08-10T10:30:04.457324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:32.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458479+0000","last_change":"2023-08-10T10:30:03.056788+0000","last_active":"2023-08-10T10:30:04.458479+0000","last_peered":"2023-08-10T10:30:04.458479+0000","last_clean":"2023-08-10T10:30:04.458479+0000","last_became_active":"2023-08-10T10:30:03.056521+0000","last_became_peered":"2023-08-10T10:30:03.056521+0000","last_unstale":"2023-08-10T10:30:04.458479+0000","last_undegraded":"2023-08-10T10:30:04.458479+0000","last_fullsized":"2023-08-10T10:30:04.458479+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:58.808247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447722+0000","last_change":"2023-08-10T10:30:03.467258+0000","last_active":"2023-08-10T10:30:04.447722+0000","last_peered":"2023-08-10T10:30:04.447722+0000","last_clean":"2023-08-10T10:30:04.447722+0000","last_became_active":"2023-08-10T10:30:03.466975+0000","last_became_peered":"2023-08-10T10:30:03.466975+0000","last_unstale":"2023-08-10T10:30:04.447722+0000","last_undegraded":"2023-08-10T10:30:04.447722+0000","last_fullsized":"2023-08-10T10:30:04.447722+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:54.329773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457566+0000","last_change":"2023-08-10T10:30:03.059437+0000","last_active":"2023-08-10T10:30:04.457566+0000","last_peered":"2023-08-10T10:30:04.457566+0000","last_clean":"2023-08-10T10:30:04.457566+0000","last_became_active":"2023-08-10T10:30:03.058147+0000","last_became_peered":"2023-08-10T10:30:03.058147+0000","last_unstale":"2023-08-10T10:30:04.457566+0000","last_undegraded":"2023-08-10T10:30:04.457566+0000","last_fullsized":"2023-08-10T10:30:04.457566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:52:47.436644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457096+0000","last_change":"2023-08-10T10:30:03.461066+0000","last_active":"2023-08-10T10:30:04.457096+0000","last_peered":"2023-08-10T10:30:04.457096+0000","last_clean":"2023-08-10T10:30:04.457096+0000","last_became_active":"2023-08-10T10:30:03.460815+0000","last_became_peered":"2023-08-10T10:30:03.460815+0000","last_unstale":"2023-08-10T10:30:04.457096+0000","last_undegraded":"2023-08-10T10:30:04.457096+0000","last_fullsized":"2023-08-10T10:30:04.457096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:40.846839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457743+0000","last_change":"2023-08-10T10:30:03.059546+0000","last_active":"2023-08-10T10:30:04.457743+0000","last_peered":"2023-08-10T10:30:04.457743+0000","last_clean":"2023-08-10T10:30:04.457743+0000","last_became_active":"2023-08-10T10:30:03.059140+0000","last_became_peered":"2023-08-10T10:30:03.059140+0000","last_unstale":"2023-08-10T10:30:04.457743+0000","last_undegraded":"2023-08-10T10:30:04.457743+0000","last_fullsized":"2023-08-10T10:30:04.457743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:20.464893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457977+0000","last_change":"2023-08-10T10:30:03.455283+0000","last_active":"2023-08-10T10:30:04.457977+0000","last_peered":"2023-08-10T10:30:04.457977+0000","last_clean":"2023-08-10T10:30:04.457977+0000","last_became_active":"2023-08-10T10:30:03.454991+0000","last_became_peered":"2023-08-10T10:30:03.454991+0000","last_unstale":"2023-08-10T10:30:04.457977+0000","last_undegraded":"2023-08-10T10:30:04.457977+0000","last_fullsized":"2023-08-10T10:30:04.457977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:51.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457786+0000","last_change":"2023-08-10T10:30:03.055798+0000","last_active":"2023-08-10T10:30:04.457786+0000","last_peered":"2023-08-10T10:30:04.457786+0000","last_clean":"2023-08-10T10:30:04.457786+0000","last_became_active":"2023-08-10T10:30:03.055504+0000","last_became_peered":"2023-08-10T10:30:03.055504+0000","last_unstale":"2023-08-10T10:30:04.457786+0000","last_undegraded":"2023-08-10T10:30:04.457786+0000","last_fullsized":"2023-08-10T10:30:04.457786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:51:25.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457583+0000","last_change":"2023-08-10T10:30:03.456300+0000","last_active":"2023-08-10T10:30:04.457583+0000","last_peered":"2023-08-10T10:30:04.457583+0000","last_clean":"2023-08-10T10:30:04.457583+0000","last_became_active":"2023-08-10T10:30:03.456022+0000","last_became_peered":"2023-08-10T10:30:03.456022+0000","last_unstale":"2023-08-10T10:30:04.457583+0000","last_undegraded":"2023-08-10T10:30:04.457583+0000","last_fullsized":"2023-08-10T10:30:04.457583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:44.516424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458270+0000","last_change":"2023-08-10T10:30:03.059087+0000","last_active":"2023-08-10T10:30:04.458270+0000","last_peered":"2023-08-10T10:30:04.458270+0000","last_clean":"2023-08-10T10:30:04.458270+0000","last_became_active":"2023-08-10T10:30:03.058616+0000","last_became_peered":"2023-08-10T10:30:03.058616+0000","last_unstale":"2023-08-10T10:30:04.458270+0000","last_undegraded":"2023-08-10T10:30:04.458270+0000","last_fullsized":"2023-08-10T10:30:04.458270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:58.291171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458265+0000","last_change":"2023-08-10T10:30:03.455560+0000","last_active":"2023-08-10T10:30:04.458265+0000","last_peered":"2023-08-10T10:30:04.458265+0000","last_clean":"2023-08-10T10:30:04.458265+0000","last_became_active":"2023-08-10T10:30:03.455085+0000","last_became_peered":"2023-08-10T10:30:03.455085+0000","last_unstale":"2023-08-10T10:30:04.458265+0000","last_undegraded":"2023-08-10T10:30:04.458265+0000","last_fullsized":"2023-08-10T10:30:04.458265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:08.937185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458586+0000","last_change":"2023-08-10T10:30:03.061373+0000","last_active":"2023-08-10T10:30:04.458586+0000","last_peered":"2023-08-10T10:30:04.458586+0000","last_clean":"2023-08-10T10:30:04.458586+0000","last_became_active":"2023-08-10T10:30:03.061086+0000","last_became_peered":"2023-08-10T10:30:03.061086+0000","last_unstale":"2023-08-10T10:30:04.458586+0000","last_undegraded":"2023-08-10T10:30:04.458586+0000","last_fullsized":"2023-08-10T10:30:04.458586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:33:16.693503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457416+0000","last_change":"2023-08-10T10:30:03.459699+0000","last_active":"2023-08-10T10:30:04.457416+0000","last_peered":"2023-08-10T10:30:04.457416+0000","last_clean":"2023-08-10T10:30:04.457416+0000","last_became_active":"2023-08-10T10:30:03.459436+0000","last_became_peered":"2023-08-10T10:30:03.459436+0000","last_unstale":"2023-08-10T10:30:04.457416+0000","last_undegraded":"2023-08-10T10:30:04.457416+0000","last_fullsized":"2023-08-10T10:30:04.457416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:14.667018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458346+0000","last_change":"2023-08-10T10:30:03.060817+0000","last_active":"2023-08-10T10:30:04.458346+0000","last_peered":"2023-08-10T10:30:04.458346+0000","last_clean":"2023-08-10T10:30:04.458346+0000","last_became_active":"2023-08-10T10:30:03.060516+0000","last_became_peered":"2023-08-10T10:30:03.060516+0000","last_unstale":"2023-08-10T10:30:04.458346+0000","last_undegraded":"2023-08-10T10:30:04.458346+0000","last_fullsized":"2023-08-10T10:30:04.458346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:11.368672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458028+0000","last_change":"2023-08-10T10:30:03.460967+0000","last_active":"2023-08-10T10:30:04.458028+0000","last_peered":"2023-08-10T10:30:04.458028+0000","last_clean":"2023-08-10T10:30:04.458028+0000","last_became_active":"2023-08-10T10:30:03.460444+0000","last_became_peered":"2023-08-10T10:30:03.460444+0000","last_unstale":"2023-08-10T10:30:04.458028+0000","last_undegraded":"2023-08-10T10:30:04.458028+0000","last_fullsized":"2023-08-10T10:30:04.458028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.997162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447757+0000","last_change":"2023-08-10T10:30:03.061961+0000","last_active":"2023-08-10T10:30:04.447757+0000","last_peered":"2023-08-10T10:30:04.447757+0000","last_clean":"2023-08-10T10:30:04.447757+0000","last_became_active":"2023-08-10T10:30:03.061628+0000","last_became_peered":"2023-08-10T10:30:03.061628+0000","last_unstale":"2023-08-10T10:30:04.447757+0000","last_undegraded":"2023-08-10T10:30:04.447757+0000","last_fullsized":"2023-08-10T10:30:04.447757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:56.612291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447673+0000","last_change":"2023-08-10T10:30:03.466456+0000","last_active":"2023-08-10T10:30:04.447673+0000","last_peered":"2023-08-10T10:30:04.447673+0000","last_clean":"2023-08-10T10:30:04.447673+0000","last_became_active":"2023-08-10T10:30:03.466123+0000","last_became_peered":"2023-08-10T10:30:03.466123+0000","last_unstale":"2023-08-10T10:30:04.447673+0000","last_undegraded":"2023-08-10T10:30:04.447673+0000","last_fullsized":"2023-08-10T10:30:04.447673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:03.233868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446159+0000","last_change":"2023-08-10T10:30:03.058707+0000","last_active":"2023-08-10T10:30:04.446159+0000","last_peered":"2023-08-10T10:30:04.446159+0000","last_clean":"2023-08-10T10:30:04.446159+0000","last_became_active":"2023-08-10T10:30:03.058428+0000","last_became_peered":"2023-08-10T10:30:03.058428+0000","last_unstale":"2023-08-10T10:30:04.446159+0000","last_undegraded":"2023-08-10T10:30:04.446159+0000","last_fullsized":"2023-08-10T10:30:04.446159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:52.668012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446398+0000","last_change":"2023-08-10T10:30:03.455911+0000","last_active":"2023-08-10T10:30:04.446398+0000","last_peered":"2023-08-10T10:30:04.446398+0000","last_clean":"2023-08-10T10:30:04.446398+0000","last_became_active":"2023-08-10T10:30:03.455626+0000","last_became_peered":"2023-08-10T10:30:03.455626+0000","last_unstale":"2023-08-10T10:30:04.446398+0000","last_undegraded":"2023-08-10T10:30:04.446398+0000","last_fullsized":"2023-08-10T10:30:04.446398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:59.292939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458023+0000","last_change":"2023-08-10T10:30:03.059102+0000","last_active":"2023-08-10T10:30:04.458023+0000","last_peered":"2023-08-10T10:30:04.458023+0000","last_clean":"2023-08-10T10:30:04.458023+0000","last_became_active":"2023-08-10T10:30:03.058884+0000","last_became_peered":"2023-08-10T10:30:03.058884+0000","last_unstale":"2023-08-10T10:30:04.458023+0000","last_undegraded":"2023-08-10T10:30:04.458023+0000","last_fullsized":"2023-08-10T10:30:04.458023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:15.435064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458589+0000","last_change":"2023-08-10T10:30:03.456245+0000","last_active":"2023-08-10T10:30:04.458589+0000","last_peered":"2023-08-10T10:30:04.458589+0000","last_clean":"2023-08-10T10:30:04.458589+0000","last_became_active":"2023-08-10T10:30:03.455293+0000","last_became_peered":"2023-08-10T10:30:03.455293+0000","last_unstale":"2023-08-10T10:30:04.458589+0000","last_undegraded":"2023-08-10T10:30:04.458589+0000","last_fullsized":"2023-08-10T10:30:04.458589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:12.370440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445996+0000","last_change":"2023-08-10T10:30:03.050912+0000","last_active":"2023-08-10T10:30:04.445996+0000","last_peered":"2023-08-10T10:30:04.445996+0000","last_clean":"2023-08-10T10:30:04.445996+0000","last_became_active":"2023-08-10T10:30:03.050654+0000","last_became_peered":"2023-08-10T10:30:03.050654+0000","last_unstale":"2023-08-10T10:30:04.445996+0000","last_undegraded":"2023-08-10T10:30:04.445996+0000","last_fullsized":"2023-08-10T10:30:04.445996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:43.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457083+0000","last_change":"2023-08-10T10:30:03.458327+0000","last_active":"2023-08-10T10:30:04.457083+0000","last_peered":"2023-08-10T10:30:04.457083+0000","last_clean":"2023-08-10T10:30:04.457083+0000","last_became_active":"2023-08-10T10:30:03.458077+0000","last_became_peered":"2023-08-10T10:30:03.458077+0000","last_unstale":"2023-08-10T10:30:04.457083+0000","last_undegraded":"2023-08-10T10:30:04.457083+0000","last_fullsized":"2023-08-10T10:30:04.457083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:21:56.076769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445848+0000","last_change":"2023-08-10T10:30:03.060936+0000","last_active":"2023-08-10T10:30:04.445848+0000","last_peered":"2023-08-10T10:30:04.445848+0000","last_clean":"2023-08-10T10:30:04.445848+0000","last_became_active":"2023-08-10T10:30:03.060607+0000","last_became_peered":"2023-08-10T10:30:03.060607+0000","last_unstale":"2023-08-10T10:30:04.445848+0000","last_undegraded":"2023-08-10T10:30:04.445848+0000","last_fullsized":"2023-08-10T10:30:04.445848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:15:05.130792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458125+0000","last_change":"2023-08-10T10:30:03.461994+0000","last_active":"2023-08-10T10:30:04.458125+0000","last_peered":"2023-08-10T10:30:04.458125+0000","last_clean":"2023-08-10T10:30:04.458125+0000","last_became_active":"2023-08-10T10:30:03.461050+0000","last_became_peered":"2023-08-10T10:30:03.461050+0000","last_unstale":"2023-08-10T10:30:04.458125+0000","last_undegraded":"2023-08-10T10:30:04.458125+0000","last_fullsized":"2023-08-10T10:30:04.458125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:22.412904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458023+0000","last_change":"2023-08-10T10:30:03.060496+0000","last_active":"2023-08-10T10:30:04.458023+0000","last_peered":"2023-08-10T10:30:04.458023+0000","last_clean":"2023-08-10T10:30:04.458023+0000","last_became_active":"2023-08-10T10:30:03.060176+0000","last_became_peered":"2023-08-10T10:30:03.060176+0000","last_unstale":"2023-08-10T10:30:04.458023+0000","last_undegraded":"2023-08-10T10:30:04.458023+0000","last_fullsized":"2023-08-10T10:30:04.458023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:39.236161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457498+0000","last_change":"2023-08-10T10:30:03.459575+0000","last_active":"2023-08-10T10:30:04.457498+0000","last_peered":"2023-08-10T10:30:04.457498+0000","last_clean":"2023-08-10T10:30:04.457498+0000","last_became_active":"2023-08-10T10:30:03.459300+0000","last_became_peered":"2023-08-10T10:30:03.459300+0000","last_unstale":"2023-08-10T10:30:04.457498+0000","last_undegraded":"2023-08-10T10:30:04.457498+0000","last_fullsized":"2023-08-10T10:30:04.457498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:28:35.475959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445686+0000","last_change":"2023-08-10T10:30:03.052867+0000","last_active":"2023-08-10T10:30:04.445686+0000","last_peered":"2023-08-10T10:30:04.445686+0000","last_clean":"2023-08-10T10:30:04.445686+0000","last_became_active":"2023-08-10T10:30:03.052338+0000","last_became_peered":"2023-08-10T10:30:03.052338+0000","last_unstale":"2023-08-10T10:30:04.445686+0000","last_undegraded":"2023-08-10T10:30:04.445686+0000","last_fullsized":"2023-08-10T10:30:04.445686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:06.444393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.456960+0000","last_change":"2023-08-10T10:30:03.455095+0000","last_active":"2023-08-10T10:30:04.456960+0000","last_peered":"2023-08-10T10:30:04.456960+0000","last_clean":"2023-08-10T10:30:04.456960+0000","last_became_active":"2023-08-10T10:30:03.454851+0000","last_became_peered":"2023-08-10T10:30:03.454851+0000","last_unstale":"2023-08-10T10:30:04.456960+0000","last_undegraded":"2023-08-10T10:30:04.456960+0000","last_fullsized":"2023-08-10T10:30:04.456960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:40:26.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458335+0000","last_change":"2023-08-10T10:30:03.057689+0000","last_active":"2023-08-10T10:30:04.458335+0000","last_peered":"2023-08-10T10:30:04.458335+0000","last_clean":"2023-08-10T10:30:04.458335+0000","last_became_active":"2023-08-10T10:30:03.057463+0000","last_became_peered":"2023-08-10T10:30:03.057463+0000","last_unstale":"2023-08-10T10:30:04.458335+0000","last_undegraded":"2023-08-10T10:30:04.458335+0000","last_fullsized":"2023-08-10T10:30:04.458335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:13.665250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458049+0000","last_change":"2023-08-10T10:28:58.307272+0000","last_active":"2023-08-10T10:30:04.458049+0000","last_peered":"2023-08-10T10:30:04.458049+0000","last_clean":"2023-08-10T10:30:04.458049+0000","last_became_active":"2023-08-10T10:28:58.306908+0000","last_became_peered":"2023-08-10T10:28:58.306908+0000","last_unstale":"2023-08-10T10:30:04.458049+0000","last_undegraded":"2023-08-10T10:30:04.458049+0000","last_fullsized":"2023-08-10T10:30:04.458049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:50.334442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457406+0000","last_change":"2023-08-10T10:30:03.465596+0000","last_active":"2023-08-10T10:30:04.457406+0000","last_peered":"2023-08-10T10:30:04.457406+0000","last_clean":"2023-08-10T10:30:04.457406+0000","last_became_active":"2023-08-10T10:30:03.465348+0000","last_became_peered":"2023-08-10T10:30:03.465348+0000","last_unstale":"2023-08-10T10:30:04.457406+0000","last_undegraded":"2023-08-10T10:30:04.457406+0000","last_fullsized":"2023-08-10T10:30:04.457406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:59:45.542297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457289+0000","last_change":"2023-08-10T10:30:03.061702+0000","last_active":"2023-08-10T10:30:04.457289+0000","last_peered":"2023-08-10T10:30:04.457289+0000","last_clean":"2023-08-10T10:30:04.457289+0000","last_became_active":"2023-08-10T10:30:03.061436+0000","last_became_peered":"2023-08-10T10:30:03.061436+0000","last_unstale":"2023-08-10T10:30:04.457289+0000","last_undegraded":"2023-08-10T10:30:04.457289+0000","last_fullsized":"2023-08-10T10:30:04.457289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:13:07.005705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457322+0000","last_change":"2023-08-10T10:28:58.307242+0000","last_active":"2023-08-10T10:30:04.457322+0000","last_peered":"2023-08-10T10:30:04.457322+0000","last_clean":"2023-08-10T10:30:04.457322+0000","last_became_active":"2023-08-10T10:28:58.306910+0000","last_became_peered":"2023-08-10T10:28:58.306910+0000","last_unstale":"2023-08-10T10:30:04.457322+0000","last_undegraded":"2023-08-10T10:30:04.457322+0000","last_fullsized":"2023-08-10T10:30:04.457322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:14.494710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458122+0000","last_change":"2023-08-10T10:30:03.460343+0000","last_active":"2023-08-10T10:30:04.458122+0000","last_peered":"2023-08-10T10:30:04.458122+0000","last_clean":"2023-08-10T10:30:04.458122+0000","last_became_active":"2023-08-10T10:30:03.460037+0000","last_became_peered":"2023-08-10T10:30:03.460037+0000","last_unstale":"2023-08-10T10:30:04.458122+0000","last_undegraded":"2023-08-10T10:30:04.458122+0000","last_fullsized":"2023-08-10T10:30:04.458122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:59.311462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.446357+0000","last_change":"2023-08-10T10:30:03.055396+0000","last_active":"2023-08-10T10:30:04.446357+0000","last_peered":"2023-08-10T10:30:04.446357+0000","last_clean":"2023-08-10T10:30:04.446357+0000","last_became_active":"2023-08-10T10:30:03.055103+0000","last_became_peered":"2023-08-10T10:30:03.055103+0000","last_unstale":"2023-08-10T10:30:04.446357+0000","last_undegraded":"2023-08-10T10:30:04.446357+0000","last_fullsized":"2023-08-10T10:30:04.446357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:41.081272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.445696+0000","last_change":"2023-08-10T10:28:58.486034+0000","last_active":"2023-08-10T10:30:04.445696+0000","last_peered":"2023-08-10T10:30:04.445696+0000","last_clean":"2023-08-10T10:30:04.445696+0000","last_became_active":"2023-08-10T10:28:58.485796+0000","last_became_peered":"2023-08-10T10:28:58.485796+0000","last_unstale":"2023-08-10T10:30:04.445696+0000","last_undegraded":"2023-08-10T10:30:04.445696+0000","last_fullsized":"2023-08-10T10:30:04.445696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:24.570877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458426+0000","last_change":"2023-08-10T10:30:03.459185+0000","last_active":"2023-08-10T10:30:04.458426+0000","last_peered":"2023-08-10T10:30:04.458426+0000","last_clean":"2023-08-10T10:30:04.458426+0000","last_became_active":"2023-08-10T10:30:03.458761+0000","last_became_peered":"2023-08-10T10:30:03.458761+0000","last_unstale":"2023-08-10T10:30:04.458426+0000","last_undegraded":"2023-08-10T10:30:04.458426+0000","last_fullsized":"2023-08-10T10:30:04.458426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:44:29.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458437+0000","last_change":"2023-08-10T10:30:03.060149+0000","last_active":"2023-08-10T10:30:04.458437+0000","last_peered":"2023-08-10T10:30:04.458437+0000","last_clean":"2023-08-10T10:30:04.458437+0000","last_became_active":"2023-08-10T10:30:03.059749+0000","last_became_peered":"2023-08-10T10:30:03.059749+0000","last_unstale":"2023-08-10T10:30:04.458437+0000","last_undegraded":"2023-08-10T10:30:04.458437+0000","last_fullsized":"2023-08-10T10:30:04.458437+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:06.395184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457520+0000","last_change":"2023-08-10T10:28:58.307151+0000","last_active":"2023-08-10T10:30:04.457520+0000","last_peered":"2023-08-10T10:30:04.457520+0000","last_clean":"2023-08-10T10:30:04.457520+0000","last_became_active":"2023-08-10T10:28:58.306854+0000","last_became_peered":"2023-08-10T10:28:58.306854+0000","last_unstale":"2023-08-10T10:30:04.457520+0000","last_undegraded":"2023-08-10T10:30:04.457520+0000","last_fullsized":"2023-08-10T10:30:04.457520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:10.612269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458660+0000","last_change":"2023-08-10T10:28:53.331719+0000","last_active":"2023-08-10T10:30:04.458660+0000","last_peered":"2023-08-10T10:30:04.458660+0000","last_clean":"2023-08-10T10:30:04.458660+0000","last_became_active":"2023-08-10T10:28:53.330532+0000","last_became_peered":"2023-08-10T10:28:53.330532+0000","last_unstale":"2023-08-10T10:30:04.458660+0000","last_undegraded":"2023-08-10T10:30:04.458660+0000","last_fullsized":"2023-08-10T10:30:04.458660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:52.278005+0000","last_clean_scrub_stamp":"2023-08-10T10:28:52.278005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:31.940759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457958+0000","last_change":"2023-08-10T10:30:03.461647+0000","last_active":"2023-08-10T10:30:04.457958+0000","last_peered":"2023-08-10T10:30:04.457958+0000","last_clean":"2023-08-10T10:30:04.457958+0000","last_became_active":"2023-08-10T10:30:03.461378+0000","last_became_peered":"2023-08-10T10:30:03.461378+0000","last_unstale":"2023-08-10T10:30:04.457958+0000","last_undegraded":"2023-08-10T10:30:04.457958+0000","last_fullsized":"2023-08-10T10:30:04.457958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:27.576604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458485+0000","last_change":"2023-08-10T10:30:03.056667+0000","last_active":"2023-08-10T10:30:04.458485+0000","last_peered":"2023-08-10T10:30:04.458485+0000","last_clean":"2023-08-10T10:30:04.458485+0000","last_became_active":"2023-08-10T10:30:03.056375+0000","last_became_peered":"2023-08-10T10:30:03.056375+0000","last_unstale":"2023-08-10T10:30:04.458485+0000","last_undegraded":"2023-08-10T10:30:04.458485+0000","last_fullsized":"2023-08-10T10:30:04.458485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:41.694972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458661+0000","last_change":"2023-08-10T10:28:58.307397+0000","last_active":"2023-08-10T10:30:04.458661+0000","last_peered":"2023-08-10T10:30:04.458661+0000","last_clean":"2023-08-10T10:30:04.458661+0000","last_became_active":"2023-08-10T10:28:58.307023+0000","last_became_peered":"2023-08-10T10:28:58.307023+0000","last_unstale":"2023-08-10T10:30:04.458661+0000","last_undegraded":"2023-08-10T10:30:04.458661+0000","last_fullsized":"2023-08-10T10:30:04.458661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:23.959034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457672+0000","last_change":"2023-08-10T10:30:03.456183+0000","last_active":"2023-08-10T10:30:04.457672+0000","last_peered":"2023-08-10T10:30:04.457672+0000","last_clean":"2023-08-10T10:30:04.457672+0000","last_became_active":"2023-08-10T10:30:03.455931+0000","last_became_peered":"2023-08-10T10:30:03.455931+0000","last_unstale":"2023-08-10T10:30:04.457672+0000","last_undegraded":"2023-08-10T10:30:04.457672+0000","last_fullsized":"2023-08-10T10:30:04.457672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:34.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457689+0000","last_change":"2023-08-10T10:30:03.053777+0000","last_active":"2023-08-10T10:30:04.457689+0000","last_peered":"2023-08-10T10:30:04.457689+0000","last_clean":"2023-08-10T10:30:04.457689+0000","last_became_active":"2023-08-10T10:30:03.053470+0000","last_became_peered":"2023-08-10T10:30:03.053470+0000","last_unstale":"2023-08-10T10:30:04.457689+0000","last_undegraded":"2023-08-10T10:30:04.457689+0000","last_fullsized":"2023-08-10T10:30:04.457689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:52.668012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458232+0000","last_change":"2023-08-10T10:28:58.307403+0000","last_active":"2023-08-10T10:30:04.458232+0000","last_peered":"2023-08-10T10:30:04.458232+0000","last_clean":"2023-08-10T10:30:04.458232+0000","last_became_active":"2023-08-10T10:28:58.306996+0000","last_became_peered":"2023-08-10T10:28:58.306996+0000","last_unstale":"2023-08-10T10:30:04.458232+0000","last_undegraded":"2023-08-10T10:30:04.458232+0000","last_fullsized":"2023-08-10T10:30:04.458232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:16.254834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447508+0000","last_change":"2023-08-10T10:30:03.467035+0000","last_active":"2023-08-10T10:30:04.447508+0000","last_peered":"2023-08-10T10:30:04.447508+0000","last_clean":"2023-08-10T10:30:04.447508+0000","last_became_active":"2023-08-10T10:30:03.466754+0000","last_became_peered":"2023-08-10T10:30:03.466754+0000","last_unstale":"2023-08-10T10:30:04.447508+0000","last_undegraded":"2023-08-10T10:30:04.447508+0000","last_fullsized":"2023-08-10T10:30:04.447508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:44:29.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.447214+0000","last_change":"2023-08-10T10:30:03.057766+0000","last_active":"2023-08-10T10:30:04.447214+0000","last_peered":"2023-08-10T10:30:04.447214+0000","last_clean":"2023-08-10T10:30:04.447214+0000","last_became_active":"2023-08-10T10:30:03.057449+0000","last_became_peered":"2023-08-10T10:30:03.057449+0000","last_unstale":"2023-08-10T10:30:04.447214+0000","last_undegraded":"2023-08-10T10:30:04.447214+0000","last_fullsized":"2023-08-10T10:30:04.447214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:58.808247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458045+0000","last_change":"2023-08-10T10:28:58.305536+0000","last_active":"2023-08-10T10:30:04.458045+0000","last_peered":"2023-08-10T10:30:04.458045+0000","last_clean":"2023-08-10T10:30:04.458045+0000","last_became_active":"2023-08-10T10:28:58.305257+0000","last_became_peered":"2023-08-10T10:28:58.305257+0000","last_unstale":"2023-08-10T10:30:04.458045+0000","last_undegraded":"2023-08-10T10:30:04.458045+0000","last_fullsized":"2023-08-10T10:30:04.458045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:20.393100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457708+0000","last_change":"2023-08-10T10:30:03.458817+0000","last_active":"2023-08-10T10:30:04.457708+0000","last_peered":"2023-08-10T10:30:04.457708+0000","last_clean":"2023-08-10T10:30:04.457708+0000","last_became_active":"2023-08-10T10:30:03.458546+0000","last_became_peered":"2023-08-10T10:30:03.458546+0000","last_unstale":"2023-08-10T10:30:04.457708+0000","last_undegraded":"2023-08-10T10:30:04.457708+0000","last_fullsized":"2023-08-10T10:30:04.457708+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:03.033985+0000","last_clean_scrub_stamp":"2023-08-10T10:30:03.033985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:20.237038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.457617+0000","last_change":"2023-08-10T10:30:03.056884+0000","last_active":"2023-08-10T10:30:04.457617+0000","last_peered":"2023-08-10T10:30:04.457617+0000","last_clean":"2023-08-10T10:30:04.457617+0000","last_became_active":"2023-08-10T10:30:03.056600+0000","last_became_peered":"2023-08-10T10:30:03.056600+0000","last_unstale":"2023-08-10T10:30:04.457617+0000","last_undegraded":"2023-08-10T10:30:04.457617+0000","last_fullsized":"2023-08-10T10:30:04.457617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:02.032217+0000","last_clean_scrub_stamp":"2023-08-10T10:30:02.032217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:27.033666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:30:04.458605+0000","last_change":"2023-08-10T10:28:58.305703+0000","last_active":"2023-08-10T10:30:04.458605+0000","last_peered":"2023-08-10T10:30:04.458605+0000","last_clean":"2023-08-10T10:30:04.458605+0000","last_became_active":"2023-08-10T10:28:58.305376+0000","last_became_peered":"2023-08-10T10:28:58.305376+0000","last_unstale":"2023-08-10T10:30:04.458605+0000","last_undegraded":"2023-08-10T10:30:04.458605+0000","last_fullsized":"2023-08-10T10:30:04.458605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:28:57.291658+0000","last_clean_scrub_stamp":"2023-08-10T10:28:57.291658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:40.724923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":174481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.312}]},{"osd":2,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.62},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503}]},{"osd":5,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64200000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":766393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.8609999999999998,"5min":5.8609999999999998,"15min":5.8609999999999998},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":6.915,"5min":6.915,"15min":6.915},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.9139999999999997,"5min":5.9139999999999997,"15min":5.9139999999999997},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.503}]},{"osd":3,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.2640000000000002,"5min":4.2640000000000002,"15min":4.2640000000000002},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":174461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.309}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.375}]},{"osd":3,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.437},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.623},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.963000000000001,"5min":21.963000000000001,"15min":21.963000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.747}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":764793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":9.5990000000000002,"5min":9.5990000000000002,"15min":9.5990000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":13.677,"5min":13.677,"15min":13.677},"last":0.442}]},{"osd":2,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":13.708,"5min":13.708,"15min":13.708},"last":0.31},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":13.602,"5min":13.602,"15min":13.602},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.4649999999999999,"5min":5.4649999999999999,"15min":5.4649999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":13.644,"5min":13.644,"15min":13.644},"last":0.628}]},{"osd":5,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.5229999999999997,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":13.515000000000001,"5min":13.515000000000001,"15min":13.515000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":175989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.37},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":174995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.628},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":174503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.626}]},{"osd":4,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":174973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.629}]},{"osd":3,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:30:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:30:08.551 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:30:08.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.711+0000 7f058ce38700 1 Processor -- start 2023-08-10T10:30:08.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.711+0000 7f058ce38700 1 -- start start 2023-08-10T10:30:08.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058ce38700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058ce38700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f058806a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058ce38700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05880b1970 con 0x7f058815ae50 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058ce38700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05880cc530 con 0x7f0588071ac0 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058ce38700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05880cba80 con 0x7f05880ceab0 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f0585d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f0586d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f058806a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f0585d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:60784/0 (socket says 172.21.15.161:60784) 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058659c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f058815ae50 0x7f05880b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:40778/0 (socket says 172.21.15.161:40778) 2023-08-10T10:30:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f0585d9b700 1 -- 172.21.15.161:0/2021844842 learned_addr learned my addr 172.21.15.161:0/2021844842 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.712+0000 7f058559a700 1 -- 172.21.15.161:0/2021844842 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053225195 0 0) 0x7f05880b1970 con 0x7f058815ae50 2023-08-10T10:30:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058559a700 1 -- 172.21.15.161:0/2021844842 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05700035b0 con 0x7f058815ae50 2023-08-10T10:30:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0586d9d700 1 -- 172.21.15.161:0/2021844842 >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 msgr2=0x7f058806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0586d9d700 1 --2- 172.21.15.161:0/2021844842 >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0586d9d700 1 -- 172.21.15.161:0/2021844842 >> v1:172.21.15.175:6789/0 conn(0x7f058815ae50 legacy=0x7f05880b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0586d9d700 1 -- 172.21.15.161:0/2021844842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880b2510 con 0x7f05880ceab0 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0585d9b700 1 --2- 172.21.15.161:0/2021844842 >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f0586d9d700 1 --2- 172.21.15.161:0/2021844842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f058806a6d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0580009d90 tx=0x7f058000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827f907cffd20c89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058559a700 1 -- 172.21.15.161:0/2021844842 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000e070 con 0x7f05880ceab0 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058559a700 1 -- 172.21.15.161:0/2021844842 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000bb20 con 0x7f05880ceab0 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058559a700 1 -- 172.21.15.161:0/2021844842 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580012430 con 0x7f05880ceab0 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058ce38700 1 -- 172.21.15.161:0/2021844842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 msgr2=0x7f058806a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.713+0000 7f058ce38700 1 --2- 172.21.15.161:0/2021844842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f058806a6d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0580009d90 tx=0x7f058000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 -- 172.21.15.161:0/2021844842 shutdown_connections 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 --2- 172.21.15.161:0/2021844842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f058806a6d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 --2- 172.21.15.161:0/2021844842 >> v2:172.21.15.175:3300/0 conn(0x7f0588071ac0 0x7f058806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 -- 172.21.15.161:0/2021844842 >> 172.21.15.161:0/2021844842 conn(0x7f05880cc740 msgr2=0x7f05880ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 -- 172.21.15.161:0/2021844842 shutdown_connections 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.714+0000 7f058ce38700 1 -- 172.21.15.161:0/2021844842 wait complete. 2023-08-10T10:30:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.715+0000 7f058ce38700 1 Processor -- start 2023-08-10T10:30:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.715+0000 7f058ce38700 1 -- start start 2023-08-10T10:30:08.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f05880c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f058815ae50 0x7f05880b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880c7ad0 con 0x7f0588071ac0 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880c6ec0 con 0x7f058815ae50 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05880c71a0 con 0x7f05880ceab0 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33754/0 (socket says 172.21.15.161:33754) 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 -- 172.21.15.161:0/3772195488 learned_addr learned my addr 172.21.15.161:0/3772195488 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0586d9d700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f058815ae50 0x7f05880b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0585d9b700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f05880c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 -- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 msgr2=0x7f05880c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f05880c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 -- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f058815ae50 msgr2=0x7f05880b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f058815ae50 0x7f05880b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 -- 172.21.15.161:0/3772195488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578009550 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0585d9b700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f05880c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058659c700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c500 tx=0x7f057c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c005cb0 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c005e10 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580009a70 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c007310 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.716+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05880c7760 con 0x7f0588071ac0 2023-08-10T10:30:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.717+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588067250 con 0x7f0588071ac0 2023-08-10T10:30:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.718+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f057c007470 con 0x7f0588071ac0 2023-08-10T10:30:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.718+0000 7f0576ffd700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 0x7f056806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.718+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f057c088900 con 0x7f0588071ac0 2023-08-10T10:30:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.718+0000 7f0585d9b700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 0x7f056806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.719+0000 7f0585d9b700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 0x7f056806d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05880c4560 tx=0x7f0578008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.723+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f057c053b00 con 0x7f0588071ac0 2023-08-10T10:30:08.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.986+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f05880c7920 con 0x7f0588071ac0 2023-08-10T10:30:08.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.990+0000 7f0576ffd700 1 -- 172.21.15.161:0/3772195488 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f057c0170e0 con 0x7f0588071ac0 2023-08-10T10:30:08.991 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-08-10T10:30:08.991 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC1u9RkxHySExAA2njciOh3wsl4O4q2eSwlJg== 2023-08-10T10:30:08.991 INFO:teuthology.orchestra.run.smithi161.stdout: caps mds = "allow" 2023-08-10T10:30:08.991 INFO:teuthology.orchestra.run.smithi161.stdout: caps mon = "allow r" 2023-08-10T10:30:08.992 INFO:teuthology.orchestra.run.smithi161.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:30:08.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 msgr2=0x7f056806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 0x7f056806d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05880c4560 tx=0x7f0578008040 comp rx=0 tx=0).stop 2023-08-10T10:30:08.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 msgr2=0x7f058814a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c500 tx=0x7f057c00c810 comp rx=0 tx=0).stop 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 shutdown_connections 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f056806ace0 0x7f056806d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f058815ae50 0x7f05880b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0588071ac0 0x7f058814a200 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 --2- 172.21.15.161:0/3772195488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05880ceab0 0x7f05880c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 >> 172.21.15.161:0/3772195488 conn(0x7f05880cc740 msgr2=0x7f058815dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 shutdown_connections 2023-08-10T10:30:08.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:08.992+0000 7f058ce38700 1 -- 172.21.15.161:0/3772195488 wait complete. 2023-08-10T10:30:08.995 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.0 2023-08-10T10:30:09.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:09.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.125+0000 7fe86e72a700 1 Processor -- start 2023-08-10T10:30:09.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.125+0000 7fe86e72a700 1 -- start start 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86e72a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe8680aea70 0x7fe8680c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86e72a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe868071940 0x7fe86806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86e72a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680cf6a0 con 0x7fe86806a190 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86e72a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86806eb80 con 0x7fe8680aea70 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86e72a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680af510 con 0x7fe868071940 2023-08-10T10:30:09.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe867fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe86806a190 0x7fe86806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39000/0 (socket says 172.21.15.161:39000) 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe867fff700 1 -- 172.21.15.161:0/882573104 learned_addr learned my addr 172.21.15.161:0/882573104 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 --2- 172.21.15.161:0/882573104 >> v2:172.21.15.175:3300/0 conn(0x7fe8680aea70 0x7fe8680c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe86ccc7700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe868071940 0x7fe86806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569802893 0 0) 0x7fe8680cf6a0 con 0x7fe86806a190 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8500035b0 con 0x7fe86806a190 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1363184682 0 0) 0x7fe8500035b0 con 0x7fe86806a190 2023-08-10T10:30:09.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 -- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe868071940 msgr2=0x7fe86806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe868071940 0x7fe86806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 -- 172.21.15.161:0/882573104 >> v1:172.21.15.161:6789/0 conn(0x7fe86806a190 legacy=0x7fe86806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 -- 172.21.15.161:0/882573104 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86806ae60 con 0x7fe8680aea70 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.126+0000 7fe8677fe700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8680aea70 0x7fe8680c6810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009840 tx=0x7fe85c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8c0df9ffa6f06 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858001670 con 0x7fe8680aea70 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c004030 con 0x7fe8680aea70 2023-08-10T10:30:09.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe866ffd700 1 -- 172.21.15.161:0/882573104 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0043a0 con 0x7fe8680aea70 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 -- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8680aea70 msgr2=0x7fe8680c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8680aea70 0x7fe8680c6810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009840 tx=0x7fe85c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 -- 172.21.15.161:0/882573104 shutdown_connections 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe868071940 0x7fe86806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 --2- 172.21.15.161:0/882573104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8680aea70 0x7fe8680c6810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 -- 172.21.15.161:0/882573104 >> 172.21.15.161:0/882573104 conn(0x7fe8680cfd70 msgr2=0x7fe8680d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 -- 172.21.15.161:0/882573104 shutdown_connections 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.127+0000 7fe86e72a700 1 -- 172.21.15.161:0/882573104 wait complete. 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.128+0000 7fe86e72a700 1 Processor -- start 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 -- start start 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe86806a190 0x7fe868146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8680aea70 0x7fe8680ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681f3ab0 con 0x7fe868071940 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86814a260 con 0x7fe86806a190 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe86e72a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681f2b70 con 0x7fe8680aea70 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe8677fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe8677fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33768/0 (socket says 172.21.15.161:33768) 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.129+0000 7fe8677fe700 1 -- 172.21.15.161:0/1831771879 learned_addr learned my addr 172.21.15.161:0/1831771879 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe867fff700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe86806a190 0x7fe868146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe86ccc7700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8680aea70 0x7fe8680ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 -- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8680aea70 msgr2=0x7fe8680ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8680aea70 0x7fe8680ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 -- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe86806a190 msgr2=0x7fe868146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe86806a190 0x7fe868146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 -- 172.21.15.161:0/1831771879 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0094a0 con 0x7fe868071940 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe8677fe700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0090b0 tx=0x7fe85c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c003dd0 con 0x7fe868071940 2023-08-10T10:30:09.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c01f070 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8681f2e30 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c011870 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.130+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8681f33f0 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.131+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8680744e0 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.131+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe85c0119d0 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.132+0000 7fe864ff9700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 0x7fe85406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.132+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe85c021070 con 0x7fe868071940 2023-08-10T10:30:09.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.132+0000 7fe867fff700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 0x7fe85406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.132+0000 7fe867fff700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 0x7fe85406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8580011e0 tx=0x7fe858001bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.136+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe85c055f20 con 0x7fe868071940 2023-08-10T10:30:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.365+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe86815ecb0 con 0x7fe868071940 2023-08-10T10:30:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.365+0000 7fe864ff9700 1 -- 172.21.15.161:0/1831771879 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fe85c059540 con 0x7fe868071940 2023-08-10T10:30:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:09.367 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/461904854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":461904854},{"type":"v1","addr":"172.21.15.175:6835","nonce":461904854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5172,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1347697385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1347697385},{"type":"v1","addr":"172.21.15.161:6836","nonce":1347697385}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5175,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/363247557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":363247557},{"type":"v1","addr":"172.21.15.161:6837","nonce":363247557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:03.437960+0000","modified":"2023-08-10T10:30:07.080791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6834/1403779871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1403779871},{"type":"v1","addr":"172.21.15.175:6834","nonce":1403779871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.367+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 msgr2=0x7fe85406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.367+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 0x7fe85406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8580011e0 tx=0x7fe858001bc0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.367+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 msgr2=0x7fe8680b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.367+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0090b0 tx=0x7fe85c004750 comp rx=0 tx=0).stop 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 shutdown_connections 2023-08-10T10:30:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe85406ace0 0x7fe85406d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8680aea70 0x7fe8680ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe86806a190 0x7fe868146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 --2- 172.21.15.161:0/1831771879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe868071940 0x7fe8680b4e30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 >> 172.21.15.161:0/1831771879 conn(0x7fe8680cfd70 msgr2=0x7fe868161640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 shutdown_connections 2023-08-10T10:30:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.368+0000 7fe86e72a700 1 -- 172.21.15.161:0/1831771879 wait complete. 2023-08-10T10:30:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 17 2023-08-10T10:30:09.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:30:03.437960+0000', 'modified': '2023-08-10T10:30:07.080791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5184': {'gid': 5184, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6834/1403779871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 1403779871}, {'type': 'v1', 'addr': '172.21.15.175:6834', 'nonce': 1403779871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:30:09.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:30:09.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:30:09.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.910+0000 7fbbd6e68700 1 Processor -- start 2023-08-10T10:30:09.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.910+0000 7fbbd6e68700 1 -- start start 2023-08-10T10:30:09.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd6e68700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbd015b050 0x7fbbd00d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd6e68700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbd00c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd6e68700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd00cc780 con 0x7fbbd00d1a40 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd6e68700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00ccd40 con 0x7fbbd015b050 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd6e68700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00cca60 con 0x7fbbd00cdef0 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbcffff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbbd00d1a40 0x7fbbd00cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39014/0 (socket says 172.21.15.161:39014) 2023-08-10T10:30:09.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbcffff700 1 -- 172.21.15.161:0/1004899162 learned_addr learned my addr 172.21.15.161:0/1004899162 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:30:09.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.911+0000 7fbbd5405700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbd00c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> v2:172.21.15.175:3300/0 conn(0x7fbbd015b050 0x7fbbd00d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923623889 0 0) 0x7fbbd00cc780 con 0x7fbbd00d1a40 2023-08-10T10:30:09.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc00035b0 con 0x7fbbd00d1a40 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893582563 0 0) 0x7fbbc00035b0 con 0x7fbbd00d1a40 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 msgr2=0x7fbbd00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbd00c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 >> v2:172.21.15.175:3300/0 conn(0x7fbbd015b050 msgr2=0x7fbbd00d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 --2- 172.21.15.161:0/1004899162 >> v2:172.21.15.175:3300/0 conn(0x7fbbd015b050 0x7fbbd00d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00c4ae0 con 0x7fbbd00d1a40 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fbbbc001670 con 0x7fbbd00d1a40 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> v2:172.21.15.175:3300/0 conn(0x7fbbd015b050 0x7fbbd00d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 >> v1:172.21.15.161:6789/0 conn(0x7fbbd00d1a40 legacy=0x7fbbd00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc0003a00 0x7fbbc0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc0004850 0x7fbbc0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbc0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00ccd40 con 0x7fbbc0003a00 2023-08-10T10:30:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00cca60 con 0x7fbbc0004850 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc000ba10 con 0x7fbbd00cdef0 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc0003a00 0x7fbbc0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcffff700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc0004850 0x7fbbc0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd5405700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbc0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 msgr2=0x7fbbc0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbc0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc0004850 msgr2=0x7fbbc0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc0004850 0x7fbbc0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1004899162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00035b0 con 0x7fbbc0003a00 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbcffff700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc0004850 0x7fbbc0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd5405700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbd00cdef0 0x7fbbc0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.912+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc0003a00 0x7fbbc0003e20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009d40 tx=0x7fbbc0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bf4da4380b6e4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4009e90 con 0x7fbbc0003a00 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400e9a0 con 0x7fbbc0003a00 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbcf7fe700 1 -- 172.21.15.161:0/1004899162 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400ed10 con 0x7fbbc0003a00 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 -- 172.21.15.161:0/1004899162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc0003a00 msgr2=0x7fbbc0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/1004899162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc0003a00 0x7fbbc0003e20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009d40 tx=0x7fbbc0005880 comp rx=0 tx=0).stop 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd5405700 1 -- 172.21.15.161:0/1004899162 reap_dead start 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 -- 172.21.15.161:0/1004899162 shutdown_connections 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 -- 172.21.15.161:0/1004899162 >> 172.21.15.161:0/1004899162 conn(0x7fbbd009a150 msgr2=0x7fbbd00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 -- 172.21.15.161:0/1004899162 shutdown_connections 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.913+0000 7fbbd6e68700 1 -- 172.21.15.161:0/1004899162 wait complete. 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.914+0000 7fbbd6e68700 1 Processor -- start 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.914+0000 7fbbd6e68700 1 -- start start 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 0x7fbbd009e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 0x7fbbd009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009bf00 con 0x7fbbd009ba80 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009e300 con 0x7fbbd015dde0 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd6e68700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009d760 con 0x7fbbc0003a00 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.915+0000 7fbbd5405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33792/0 (socket says 172.21.15.161:33792) 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 -- 172.21.15.161:0/2692213724 learned_addr learned my addr 172.21.15.161:0/2692213724 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 0x7fbbd009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 0x7fbbd009e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 -- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 msgr2=0x7fbbd009e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 0x7fbbd009e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 -- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 msgr2=0x7fbbd009b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 0x7fbbd009b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 -- 172.21.15.161:0/2692213724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd009d9d0 con 0x7fbbd009ba80 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 0x7fbbd009b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 0x7fbbd009e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006dc80 tx=0x7fbbc80104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbcd7fa700 1 -- 172.21.15.161:0/2692213724 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800e050 con 0x7fbbd009ba80 2023-08-10T10:30:09.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbcd7fa700 1 -- 172.21.15.161:0/2692213724 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800f040 con 0x7fbbd009ba80 2023-08-10T10:30:09.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd009dcb0 con 0x7fbbd009ba80 2023-08-10T10:30:09.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbcd7fa700 1 -- 172.21.15.161:0/2692213724 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8010e50 con 0x7fbbd009ba80 2023-08-10T10:30:09.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.916+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd00b4de0 con 0x7fbbd009ba80 2023-08-10T10:30:09.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.918+0000 7fbbcd7fa700 1 -- 172.21.15.161:0/2692213724 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbbc8003a20 con 0x7fbbd009ba80 2023-08-10T10:30:09.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.918+0000 7fbbcd7fa700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 0x7fbbb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.918+0000 7fbbcd7fa700 1 -- 172.21.15.161:0/2692213724 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbc8089960 con 0x7fbbd009ba80 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.918+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 0x7fbbb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.919+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 0x7fbbb406d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4000c00 tx=0x7fbbc401e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.920+0000 7fbbe3001b80 1 Processor -- start 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.920+0000 7fbbe3001b80 1 -- start start 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 0x561946eea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946eede50 0x561946eee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946e3ed70 con 0x561946ec3980 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946e1b540 con 0x561946eede50 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561946e18e60 con 0x561946ec1070 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33796/0 (socket says 172.21.15.161:33796) 2023-08-10T10:30:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1340763888 learned_addr learned my addr 172.21.15.161:0/1340763888 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd5405700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946eede50 0x561946eee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbcffff700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 0x561946eea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 msgr2=0x561946eea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 0x561946eea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946eede50 msgr2=0x561946eee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946eede50 0x561946eee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 -- 172.21.15.161:0/1340763888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561946c955e0 con 0x561946ec3980 2023-08-10T10:30:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbcffff700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 0x561946eea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00047b0 tx=0x7fbbc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9a8081fe6d01c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.921+0000 7fbbba7fc700 1 -- 172.21.15.161:0/1340763888 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc402e070 con 0x561946ec3980 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbba7fc700 1 -- 172.21.15.161:0/1340763888 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400fe60 con 0x561946ec3980 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbba7fc700 1 -- 172.21.15.161:0/1340763888 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4021040 con 0x561946ec3980 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 -- 172.21.15.161:0/1340763888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 msgr2=0x561946ec3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00047b0 tx=0x7fbbc4013000 comp rx=0 tx=0).stop 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 -- 172.21.15.161:0/1340763888 shutdown_connections 2023-08-10T10:30:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946eede50 0x561946eee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec3980 0x561946ec3d60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/1340763888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec1070 0x561946eea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 -- 172.21.15.161:0/1340763888 >> 172.21.15.161:0/1340763888 conn(0x561946e20c80 msgr2=0x561946f08b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 -- 172.21.15.161:0/1340763888 shutdown_connections 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.922+0000 7fbbe3001b80 1 -- 172.21.15.161:0/1340763888 wait complete. 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.923+0000 7fbbe3001b80 1 -- start start 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.923+0000 7fbbe3001b80 1 Processor -- start 2023-08-10T10:30:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946f04fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946ee1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946e14750 con 0x561946ec1070 2023-08-10T10:30:09.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946db3a70 con 0x561946ec3980 2023-08-10T10:30:09.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561946db3770 con 0x561946eede50 2023-08-10T10:30:09.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 10 client.0 _ll_register_callbacks cb 0x561946db1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:30:09.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33802/0 (socket says 172.21.15.161:33802) 2023-08-10T10:30:09.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 -- 172.21.15.161:0/2643418 learned_addr learned my addr 172.21.15.161:0/2643418 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946f04fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946ee1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 -- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 msgr2=0x561946ee1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946ee1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 -- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 msgr2=0x561946f04fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946f04fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 -- 172.21.15.161:0/2643418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc00035b0 con 0x561946ec1070 2023-08-10T10:30:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946ee1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946f04fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4029040 tx=0x7fbbc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63ac317bed57ba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-08-10T10:30:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4021070 con 0x561946ec1070 2023-08-10T10:30:09.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbc4003bf0 con 0x561946ec1070 2023-08-10T10:30:09.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.924+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561946eb6010 con 0x561946ec1070 2023-08-10T10:30:09.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc402e050 con 0x561946ec1070 2023-08-10T10:30:09.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 10 client.5343 fetch_fsmap learned FSMap version 17 2023-08-10T10:30:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561946c41d90 con 0x561946ec1070 2023-08-10T10:30:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561946eb6010 con 0x561946ec1070 2023-08-10T10:30:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbbc4013470 con 0x561946ec1070 2023-08-10T10:30:09.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 10 client.5343 fetch_fsmap finished waiting for FSMap version 17 2023-08-10T10:30:09.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 10 client.5343 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:30:09.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 20 client.5343 populate_metadata read hostname 'smithi161' 2023-08-10T10:30:09.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946ee0d70 0x561946eead50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 4 client.5343 mds_command: new command op to 5184 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:30:09.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 --> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561946e92b70 con 0x561946ee0d70 2023-08-10T10:30:09.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.925+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946ee0d70 0x561946eead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.926+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946ee0d70 0x561946eead50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59d52b390cbe0c38 server_cookie=e29258a5e1ae0ae1 in_seq=0 out_seq=0 2023-08-10T10:30:09.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.926+0000 7fbbaf7fe700 10 client.5343 ms_handle_connect on v2:172.21.15.175:6832/1403779871 2023-08-10T10:30:09.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.926+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2643418 <== mds.0 v2:172.21.15.175:6832/1403779871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561946e92b70 con 0x561946ee0d70 2023-08-10T10:30:09.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.926+0000 7fbbaf7fe700 10 client.5343 handle_command_reply: tid=0 2023-08-10T10:30:09.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.926+0000 7fbbe3001b80 1 client.5343 shutdown 2023-08-10T10:30:09.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 msgr2=0x561946ee6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4029040 tx=0x7fbbc4004750 comp rx=0 tx=0).stop 2023-08-10T10:30:09.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 shutdown_connections 2023-08-10T10:30:09.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946ee1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946ee0d70 0x561946eead50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ee6060 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2643418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946f04fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbaf7fe700 0 client.5343 ms_handle_reset on v2:172.21.15.175:6832/1403779871 2023-08-10T10:30:09.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 >> 172.21.15.161:0/2643418 conn(0x561946e20c80 msgr2=0x561946ec4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 shutdown_connections 2023-08-10T10:30:09.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2643418 wait complete. 2023-08-10T10:30:09.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.927+0000 7fbbe3001b80 20 client.5343 trim_cache size 0 max 16384 2023-08-10T10:30:09.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.944+0000 7fbbe3001b80 1 Processor -- start 2023-08-10T10:30:09.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.944+0000 7fbbe3001b80 1 -- start start 2023-08-10T10:30:09.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946eebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946eec020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946c978d0 con 0x561946ec1070 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946ee5010 con 0x561946ec3980 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561946eed550 con 0x561946eede50 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33810/0 (socket says 172.21.15.161:33810) 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 -- 172.21.15.161:0/3672799342 learned_addr learned my addr 172.21.15.161:0/3672799342 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbcffff700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946eebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd5405700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946eec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 -- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 msgr2=0x561946eec020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946eec020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 -- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 msgr2=0x561946eebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.945+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946eebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbd4c04700 1 -- 172.21.15.161:0/3672799342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561946c2ac10 con 0x561946ec1070 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbcffff700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946eebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400fca0 tx=0x7fbbc4035070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b534321e19b8c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbbaffd700 1 -- 172.21.15.161:0/3672799342 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc402e040 con 0x561946ec1070 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbbaffd700 1 -- 172.21.15.161:0/3672799342 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc402f040 con 0x561946ec1070 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbbaffd700 1 -- 172.21.15.161:0/3672799342 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4013b70 con 0x561946ec1070 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 -- 172.21.15.161:0/3672799342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 msgr2=0x561946ebff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400fca0 tx=0x7fbbc4035070 comp rx=0 tx=0).stop 2023-08-10T10:30:09.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 -- 172.21.15.161:0/3672799342 shutdown_connections 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946eede50 0x561946eec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946ec1070 0x561946ebff40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/3672799342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec3980 0x561946eebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 -- 172.21.15.161:0/3672799342 >> 172.21.15.161:0/3672799342 conn(0x561946e20c80 msgr2=0x561946ec2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 -- 172.21.15.161:0/3672799342 shutdown_connections 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.946+0000 7fbbe3001b80 1 -- 172.21.15.161:0/3672799342 wait complete. 2023-08-10T10:30:09.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.947+0000 7fbbe3001b80 1 -- start start 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.947+0000 7fbbe3001b80 1 Processor -- start 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec1070 0x561946ec2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec3980 0x561946ebd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946f6f330 con 0x561946eede50 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561946f08b00 con 0x561946ec1070 2023-08-10T10:30:09.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561946f08de0 con 0x561946ec3980 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbe3001b80 10 client.0 _ll_register_callbacks cb 0x561946db1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33820/0 (socket says 172.21.15.161:33820) 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 -- 172.21.15.161:0/2367283252 learned_addr learned my addr 172.21.15.161:0/2367283252 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec1070 0x561946ec2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbcffff700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec3980 0x561946ebd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 -- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec3980 msgr2=0x561946ebd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec3980 0x561946ebd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 -- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec1070 msgr2=0x561946ec2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec1070 0x561946ec2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 -- 172.21.15.161:0/2367283252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561946c41d90 con 0x561946eede50 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbd5405700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80583c0 tx=0x7fbbc8058130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb79f51999c78cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.948+0000 7fbbaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8060780 con 0x561946eede50 2023-08-10T10:30:09.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbc805c130 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbc400fe60 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc805c2f0 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 10 client.5349 fetch_fsmap learned FSMap version 17 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561946c68200 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400fe60 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbbc80544b0 con 0x561946eede50 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 10 client.5349 fetch_fsmap finished waiting for FSMap version 17 2023-08-10T10:30:09.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 10 client.5349 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 20 client.5349 populate_metadata read hostname 'smithi161' 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946f6e3b0 0x561946f6e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 4 client.5349 mds_command: new command op to 5184 tid=0[{"prefix": "status"}] 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 --> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561946e0d730 con 0x561946f6e3b0 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.949+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946f6e3b0 0x561946f6e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbaf7fe700 10 client.5349 ms_handle_connect on v2:172.21.15.175:6832/1403779871 2023-08-10T10:30:09.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbd4c04700 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946f6e3b0 0x561946f6e790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3bfbb2c9237ac86 server_cookie=8f0fee9f81b8f6e5 in_seq=0 out_seq=0 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbaf7fe700 1 -- 172.21.15.161:0/2367283252 <== mds.0 v2:172.21.15.175:6832/1403779871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561946e0d730 con 0x561946f6e3b0 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbaf7fe700 10 client.5349 handle_command_reply: tid=0 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 client.5349 shutdown 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 msgr2=0x561946ebfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80583c0 tx=0x7fbbc8058130 comp rx=0 tx=0).stop 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 shutdown_connections 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:6832/1403779871,v1:172.21.15.175:6834/1403779871] conn(0x561946f6e3b0 0x561946f6e790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561946eede50 0x561946ebfe40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbaf7fe700 0 client.5349 ms_handle_reset on v2:172.21.15.175:6832/1403779871 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561946ec1070 0x561946ec2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 --2- 172.21.15.161:0/2367283252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561946ec3980 0x561946ebd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 >> 172.21.15.161:0/2367283252 conn(0x561946e20c80 msgr2=0x561946ee27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 shutdown_connections 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 1 -- 172.21.15.161:0/2367283252 wait complete. 2023-08-10T10:30:09.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbe3001b80 20 client.5349 trim_cache size 0 max 16384 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e", 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 5184, 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-08-10T10:30:09.967 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 5.8855252760000001, 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 17, 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 37, 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 37, 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 13.791571299999999 2023-08-10T10:30:09.968 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-08-10T10:30:09.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.950+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 msgr2=0x7fbbb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 0x7fbbb406d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4000c00 tx=0x7fbbc401e040 comp rx=0 tx=0).stop 2023-08-10T10:30:09.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 msgr2=0x7fbbd00b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006dc80 tx=0x7fbbc80104a0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 shutdown_connections 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fbbb406ace0 0x7fbbb406d1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbd009ba80 0x7fbbd00b5a60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc0003a00 0x7fbbd009e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 --2- 172.21.15.161:0/2692213724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbd015dde0 0x7fbbd009b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 >> 172.21.15.161:0/2692213724 conn(0x7fbbd009a150 msgr2=0x7fbbd00c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 shutdown_connections 2023-08-10T10:30:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:09.951+0000 7fbbd6e68700 1 -- 172.21.15.161:0/2692213724 wait complete. 2023-08-10T10:30:09.972 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:30:10.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.090+0000 7f7df5170700 1 Processor -- start 2023-08-10T10:30:10.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.090+0000 7f7df5170700 1 -- start start 2023-08-10T10:30:10.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7df5170700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7df015b050 0x7f7df00d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7df5170700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00cc780 con 0x7f7df00cdef0 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7df5170700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00cca60 con 0x7f7df00d1a40 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7df5170700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df00ccd40 con 0x7f7df015b050 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7deed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7df015b050 0x7f7df00d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7deed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7df015b050 0x7f7df00d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33824/0 (socket says 172.21.15.161:33824) 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.091+0000 7f7deed9d700 1 -- 172.21.15.161:0/2737327659 learned_addr learned my addr 172.21.15.161:0/2737327659 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7deed9d700 1 -- 172.21.15.161:0/2737327659 >> v1:172.21.15.175:6789/0 conn(0x7f7df00d1a40 legacy=0x7f7df00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7deed9d700 1 -- 172.21.15.161:0/2737327659 >> v1:172.21.15.161:6789/0 conn(0x7f7df00cdef0 legacy=0x7f7df00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7deed9d700 1 -- 172.21.15.161:0/2737327659 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00c4ae0 con 0x7f7df015b050 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7deed9d700 1 --2- 172.21.15.161:0/2737327659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df00d1500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad2b4379323ef7d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7dedd9b700 1 -- 172.21.15.161:0/2737327659 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4005e30 con 0x7f7df015b050 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7dedd9b700 1 -- 172.21.15.161:0/2737327659 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4006030 con 0x7f7df015b050 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7dedd9b700 1 -- 172.21.15.161:0/2737327659 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40063e0 con 0x7f7df015b050 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 -- 172.21.15.161:0/2737327659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 msgr2=0x7f7df00d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 --2- 172.21.15.161:0/2737327659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df00d1500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 -- 172.21.15.161:0/2737327659 shutdown_connections 2023-08-10T10:30:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 --2- 172.21.15.161:0/2737327659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df00d1500 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 -- 172.21.15.161:0/2737327659 >> 172.21.15.161:0/2737327659 conn(0x7f7df009a150 msgr2=0x7f7df00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 -- 172.21.15.161:0/2737327659 shutdown_connections 2023-08-10T10:30:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.092+0000 7f7df5170700 1 -- 172.21.15.161:0/2737327659 wait complete. 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.094+0000 7f7df5170700 1 Processor -- start 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.094+0000 7f7df5170700 1 -- start start 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7df00cdef0 0x7f7df00ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7df00d1a40 0x7f7df0157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df015e240 con 0x7f7df015b050 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df01563d0 con 0x7f7df00d1a40 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7df5170700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df01566c0 con 0x7f7df00cdef0 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7def59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7def59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33834/0 (socket says 172.21.15.161:33834) 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7def59e700 1 -- 172.21.15.161:0/2525479047 learned_addr learned my addr 172.21.15.161:0/2525479047 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7dee59c700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7df00d1a40 0x7f7df0157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.095+0000 7f7deed9d700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7df00cdef0 0x7f7df00ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 -- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7df00cdef0 msgr2=0x7f7df00ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7df00cdef0 0x7f7df00ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 -- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7df00d1a40 msgr2=0x7f7df0157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7df00d1a40 0x7f7df0157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 -- 172.21.15.161:0/2525479047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009500 con 0x7f7df015b050 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7def59e700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7de800cc50 tx=0x7f7de800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8003c00 con 0x7f7df015b050 2023-08-10T10:30:10.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8003d60 con 0x7f7df015b050 2023-08-10T10:30:10.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df01569a0 con 0x7f7df015b050 2023-08-10T10:30:10.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800aab0 con 0x7f7df015b050 2023-08-10T10:30:10.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.096+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df0156f60 con 0x7f7df015b050 2023-08-10T10:30:10.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.097+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df0157180 con 0x7f7df015b050 2023-08-10T10:30:10.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.098+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7de800ac10 con 0x7f7df015b050 2023-08-10T10:30:10.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.098+0000 7f7dd77fe700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 0x7f7ddc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.098+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7de8089410 con 0x7f7df015b050 2023-08-10T10:30:10.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.098+0000 7f7deed9d700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 0x7f7ddc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.098+0000 7f7deed9d700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 0x7f7ddc06d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7de4013040 tx=0x7f7de4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.102+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7de80544c0 con 0x7f7df015b050 2023-08-10T10:30:10.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.336+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7df00744e0 con 0x7f7df015b050 2023-08-10T10:30:10.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.337+0000 7f7dd77fe700 1 -- 172.21.15.161:0/2525479047 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7de8057ae0 con 0x7f7df015b050 2023-08-10T10:30:10.338 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:30:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 msgr2=0x7f7ddc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 0x7f7ddc06d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7de4013040 tx=0x7f7de4008070 comp rx=0 tx=0).stop 2023-08-10T10:30:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 msgr2=0x7f7df0155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7de800cc50 tx=0x7f7de800cf60 comp rx=0 tx=0).stop 2023-08-10T10:30:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 shutdown_connections 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f7ddc06ace0 0x7f7ddc06d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7df015b050 0x7f7df0155e90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7df00cdef0 0x7f7df00ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 --2- 172.21.15.161:0/2525479047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7df00d1a40 0x7f7df0157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 >> 172.21.15.161:0/2525479047 conn(0x7f7df009a150 msgr2=0x7f7df00d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 shutdown_connections 2023-08-10T10:30:10.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:30:10.339+0000 7f7df5170700 1 -- 172.21.15.161:0/2525479047 wait complete. 2023-08-10T10:30:10.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:30:10.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:30:10.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-08-10T10:30:10.353 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:30:10.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:30:10.354 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:30:10.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:30:10.354 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:30:10.354 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:30:10.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.355 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-08-10T10:30:10.372 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:30:10.373 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:30:10.373 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:30:10.373 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.373 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-08-10T10:30:10.373 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:30:10.374 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 41357sec preferred_lft 41357sec 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::95b4:a538:eaa3:f29/64 scope link noprefixroute 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 16:98:15:44:d8:0b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:10.375 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c00e:87ff:fed5:d247/64 scope link 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 3a:b2:36:50:3f:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::38b2:36ff:fe50:3f9b/64 scope link 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.376 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:30:10.377 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 16:98:15:44:d8:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:30:10.377 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::1498:15ff:fe44:d80b/64 scope link 2023-08-10T10:30:10.377 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:10.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.378 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:30:10.438 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-08-10T10:30:10.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.439 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-08-10T10:30:10.497 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-08-10T10:30:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:30:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:30:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:30:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:30:10.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.499 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-08-10T10:30:10.499 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-08-10T10:30:10.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:30:10.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:30:10.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:30:10.500 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-08-10T10:30:10.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.603 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-08-10T10:30:10.619 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:30:10.619 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:30:10.620 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:30:10.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.620 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-08-10T10:30:10.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:30:10.687 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:30:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:30:10.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:30:10.744 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:30:10.800 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:30:10.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.801 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:30:10.885 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:30:10.885 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:30:10.912 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:30:10.912 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 0@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:30:10.913 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 0@bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e.cephfs=/ 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.161:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2023-08-10T10:30:10.943 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: v2 mount support check returned 2 2023-08-10T10:30:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-10T10:30:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-10T10:30:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-08-10T10:30:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-08-10T10:30:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e" will pass to kernel 2023-08-10T10:30:10.946 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:30:10.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.946 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:30:10.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:10.982 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:30:11.069 INFO:teuthology.orchestra.run.smithi161.stdout:client5161 2023-08-10T10:30:11.070 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:30:11.070 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:30:11.086 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=xfstests-dev 2023-08-10T10:30:11.143 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.arJpumkS1bxfstests-dev 2023-08-10T10:30:11.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:11.144 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.arJpumkS1bxfstests-dev) 2023-08-10T10:30:11.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:11.210 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.arJpumkS1bxfstests-dev) 2023-08-10T10:30:11.266 INFO:teuthology.orchestra.run.smithi161.stderr:Cloning into '/tmp/tmp.arJpumkS1bxfstests-dev'... 2023-08-10T10:30:12.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:12.079 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-10T10:30:12.140 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=test 2023-08-10T10:30:12.196 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.nl7OU3OXQatest 2023-08-10T10:30:12.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:12.197 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-10T10:30:12.254 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=scratch 2023-08-10T10:30:12.310 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:30:12.310 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-08-10T10:30:12.311 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-08-10T10:30:12.709 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-08-10T10:30:13.564 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:08:17 ago on Thu 10 Aug 2023 10:21:56 AM UTC. 2023-08-10T10:30:14.842 INFO:teuthology.orchestra.run.smithi161.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:30:14.843 INFO:teuthology.orchestra.run.smithi161.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:30:14.844 INFO:teuthology.orchestra.run.smithi161.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-08-10T10:30:14.845 INFO:teuthology.orchestra.run.smithi161.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-08-10T10:30:14.846 INFO:teuthology.orchestra.run.smithi161.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-08-10T10:30:14.848 INFO:teuthology.orchestra.run.smithi161.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-08-10T10:30:14.850 INFO:teuthology.orchestra.run.smithi161.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-08-10T10:30:14.851 INFO:teuthology.orchestra.run.smithi161.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-08-10T10:30:14.853 INFO:teuthology.orchestra.run.smithi161.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-08-10T10:30:14.854 INFO:teuthology.orchestra.run.smithi161.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-08-10T10:30:14.856 INFO:teuthology.orchestra.run.smithi161.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-08-10T10:30:14.857 INFO:teuthology.orchestra.run.smithi161.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-08-10T10:30:14.858 INFO:teuthology.orchestra.run.smithi161.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-08-10T10:30:14.859 INFO:teuthology.orchestra.run.smithi161.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-08-10T10:30:14.860 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:30:14.861 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:30:14.862 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:30:14.863 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:30:14.864 INFO:teuthology.orchestra.run.smithi161.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-08-10T10:30:14.866 INFO:teuthology.orchestra.run.smithi161.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:30:14.867 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:30:14.869 INFO:teuthology.orchestra.run.smithi161.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-08-10T10:30:14.873 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:30:14.988 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-08-10T10:30:14.990 INFO:teuthology.orchestra.run.smithi161.stdout:==================================================================================================================== 2023-08-10T10:30:14.990 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-08-10T10:30:14.990 INFO:teuthology.orchestra.run.smithi161.stdout:==================================================================================================================== 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-08-10T10:30:14.991 INFO:teuthology.orchestra.run.smithi161.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-08-10T10:30:14.992 INFO:teuthology.orchestra.run.smithi161.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-08-10T10:30:14.992 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-08-10T10:30:14.992 INFO:teuthology.orchestra.run.smithi161.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-08-10T10:30:14.992 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-08-10T10:30:14.992 INFO:teuthology.orchestra.run.smithi161.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2023-08-10T10:30:14.993 INFO:teuthology.orchestra.run.smithi161.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout: python27 2.7 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout:==================================================================================================================== 2023-08-10T10:30:14.994 INFO:teuthology.orchestra.run.smithi161.stdout:Install 14 Packages 2023-08-10T10:30:14.995 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 2 Packages 2023-08-10T10:30:14.995 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:30:14.995 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 12 M 2023-08-10T10:30:14.995 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-08-10T10:30:15.159 INFO:teuthology.orchestra.run.smithi161.stdout:(1/16): python2-setuptools-39.0.1-13.module+el8 5.3 MB/s | 642 kB 00:00 2023-08-10T10:30:15.183 INFO:teuthology.orchestra.run.smithi161.stdout:(2/16): python2-setuptools-wheel-39.0.1-13.modu 2.0 MB/s | 287 kB 00:00 2023-08-10T10:30:15.234 INFO:teuthology.orchestra.run.smithi161.stdout:(3/16): python2-wheel-wheel-0.31.1-3.module+el8 596 kB/s | 45 kB 00:00 2023-08-10T10:30:15.276 INFO:teuthology.orchestra.run.smithi161.stdout:(4/16): fio-3.19-3.el8.x86_64.rpm 5.7 MB/s | 538 kB 00:00 2023-08-10T10:30:15.301 INFO:teuthology.orchestra.run.smithi161.stdout:(5/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 92 kB 00:00 2023-08-10T10:30:15.421 INFO:teuthology.orchestra.run.smithi161.stdout:(6/16): python2-2.7.18-10.module+el8.6.0+14191+ 759 kB/s | 110 kB 00:00 2023-08-10T10:30:15.552 INFO:teuthology.orchestra.run.smithi161.stdout:(7/16): python2-libs-2.7.18-10.module+el8.6.0+1 24 MB/s | 6.0 MB 00:00 2023-08-10T10:30:15.602 INFO:teuthology.orchestra.run.smithi161.stdout:(8/16): python2-pip-9.0.3-19.module+el8.6.0+130 9.1 MB/s | 1.6 MB 00:00 2023-08-10T10:30:15.635 INFO:teuthology.orchestra.run.smithi161.stdout:(9/16): python2-pip-wheel-9.0.3-19.module+el8.6 10 MB/s | 892 kB 00:00 2023-08-10T10:30:15.661 INFO:teuthology.orchestra.run.smithi161.stdout:(10/16): dump-0.4-0.36.b46.el8.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2023-08-10T10:30:15.694 INFO:teuthology.orchestra.run.smithi161.stdout:(11/16): rmt-1.5.3-13.el8.x86_64.rpm 877 kB/s | 51 kB 00:00 2023-08-10T10:30:15.720 INFO:teuthology.orchestra.run.smithi161.stdout:(12/16): daxctl-libs-71.1-3.el8.x86_64.rpm 709 kB/s | 42 kB 00:00 2023-08-10T10:30:15.770 INFO:teuthology.orchestra.run.smithi161.stdout:(13/16): ndctl-libs-71.1-3.el8.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-08-10T10:30:15.812 INFO:teuthology.orchestra.run.smithi161.stdout:(14/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 7.1 MB/s | 668 kB 00:00 2023-08-10T10:30:15.845 INFO:teuthology.orchestra.run.smithi161.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2023-08-10T10:30:32.608 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:32.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:02.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:02.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:32.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:32.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:02.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:02.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:26.447 INFO:teuthology.orchestra.run.smithi161.stdout:[MIRROR] indent-2.2.13-2.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/i/indent-2.2.13-2.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:32:26.613 INFO:teuthology.orchestra.run.smithi161.stdout:(16/16): indent-2.2.13-2.el8.x86_64.rpm 1.4 kB/s | 187 kB 02:11 2023-08-10T10:32:26.613 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:32:26.614 INFO:teuthology.orchestra.run.smithi161.stdout:Total 92 kB/s | 12 MB 02:11 2023-08-10T10:32:26.814 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-08-10T10:32:26.854 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-08-10T10:32:26.854 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-08-10T10:32:27.039 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-08-10T10:32:27.044 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-08-10T10:32:27.753 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-08-10T10:32:27.953 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-08-10T10:32:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-08-10T10:32:28.166 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-08-10T10:32:28.365 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-08-10T10:32:28.435 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-08-10T10:32:28.598 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-08-10T10:32:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-08-10T10:32:28.869 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-08-10T10:32:29.001 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 6/18 2023-08-10T10:32:29.252 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 7/18 2023-08-10T10:32:29.902 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 8/18 2023-08-10T10:32:30.187 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-08-10T10:32:30.392 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-08-10T10:32:31.509 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-08-10T10:32:31.798 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 11/18 2023-08-10T10:32:32.106 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-08-10T10:32:32.361 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-08-10T10:32:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-08-10T10:32:32.714 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-08-10T10:32:32.890 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-08-10T10:32:32.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:32.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:33.048 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-08-10T10:32:33.195 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-08-10T10:32:33.452 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-08-10T10:32:33.454 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-08-10T10:32:33.454 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 2/18 2023-08-10T10:32:33.454 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 3/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 4/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fio-3.19-3.el8.x86_64 5/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 7/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 8/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 10/18 2023-08-10T10:32:33.455 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-08-10T10:32:33.456 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 12/18 2023-08-10T10:32:33.456 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 13/18 2023-08-10T10:32:33.456 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 14/18 2023-08-10T10:32:33.456 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-08-10T10:32:33.456 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-08-10T10:32:33.457 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-08-10T10:32:34.709 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-08-10T10:32:34.709 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:10:38 ago on Thu 10 Aug 2023 10:21:56 AM UTC. 2023-08-10T10:32:37.203 INFO:teuthology.orchestra.run.smithi161.stdout:Installed products updated. 2023-08-10T10:32:37.396 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:32:37.396 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-08-10T10:32:37.397 INFO:teuthology.orchestra.run.smithi161.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-08-10T10:32:37.397 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-08-10T10:32:37.397 INFO:teuthology.orchestra.run.smithi161.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-08-10T10:32:37.397 INFO:teuthology.orchestra.run.smithi161.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-08-10T10:32:37.398 INFO:teuthology.orchestra.run.smithi161.stdout: fio-3.19-3.el8.x86_64 2023-08-10T10:32:37.398 INFO:teuthology.orchestra.run.smithi161.stdout: indent-2.2.13-2.el8.x86_64 2023-08-10T10:32:37.398 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-08-10T10:32:37.398 INFO:teuthology.orchestra.run.smithi161.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-08-10T10:32:37.398 INFO:teuthology.orchestra.run.smithi161.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-08-10T10:32:37.399 INFO:teuthology.orchestra.run.smithi161.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-08-10T10:32:37.400 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:32:37.400 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-08-10T10:32:37.547 DEBUG:teuthology.orchestra.run.smithi161:> sudo useradd -m fsgqa 2023-08-10T10:32:37.575 INFO:teuthology.orchestra.run.smithi161.stderr:useradd: user 'fsgqa' already exists 2023-08-10T10:32:37.576 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-10T10:32:37.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo groupadd fsgqa 2023-08-10T10:32:37.643 INFO:teuthology.orchestra.run.smithi161.stderr:groupadd: group 'fsgqa' already exists 2023-08-10T10:32:37.645 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-10T10:32:37.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo useradd fsgqa2 2023-08-10T10:32:38.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo useradd 123456-fsgqa 2023-08-10T10:32:39.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-10T10:32:39.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.473+0000 7fe5aad61700 1 Processor -- start 2023-08-10T10:32:39.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.473+0000 7fe5aad61700 1 -- start start 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5aad61700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe5a40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5aad61700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a415b290 con 0x7fe5a406e650 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5aad61700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a415b570 con 0x7fe5a4071d10 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5aad61700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c5890 con 0x7fe5a4154620 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5a92fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe5a406e650 0x7fe5a415a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39102/0 (socket says 172.21.15.161:39102) 2023-08-10T10:32:39.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5a92fe700 1 -- 172.21.15.161:0/484449142 learned_addr learned my addr 172.21.15.161:0/484449142 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.474+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe5a40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917358165 0 0) 0x7fe5a415b290 con 0x7fe5a406e650 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5940035b0 con 0x7fe5a406e650 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702294215 0 0) 0x7fe5a415b570 con 0x7fe5a4071d10 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a415b290 con 0x7fe5a4071d10 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862666895 0 0) 0x7fe5940035b0 con 0x7fe5a406e650 2023-08-10T10:32:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 msgr2=0x7fe5a40717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe5a40717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 >> v1:172.21.15.175:6789/0 conn(0x7fe5a4071d10 legacy=0x7fe5a406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4070cf0 con 0x7fe5a406e650 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1829188148 0 0) 0x7fe59c0019f0 con 0x7fe5a406e650 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 >> v1:172.21.15.161:6789/0 conn(0x7fe5a406e650 legacy=0x7fe5a415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594003bc0 0x7fe594003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe594004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe594004d90 0x7fe594005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c5890 con 0x7fe594004d90 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59400bac0 con 0x7fe594003bc0 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59400bc30 con 0x7fe5a4154620 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe594004d90 0x7fe594005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594003bc0 0x7fe594003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a3fff700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe594004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 -- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 msgr2=0x7fe594004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a4154620 0x7fe594004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 -- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594003bc0 msgr2=0x7fe594003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594003bc0 0x7fe594003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 -- 172.21.15.161:0/484449142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940035b0 con 0x7fe594004d90 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.475+0000 7fe5a92fe700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe594004d90 0x7fe594005210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00a7a0 tx=0x7fe594005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c31c2f91d296dca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c012600 con 0x7fe594004d90 2023-08-10T10:32:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c012780 con 0x7fe594004d90 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5a37fe700 1 -- 172.21.15.161:0/484449142 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c012b30 con 0x7fe594004d90 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 -- 172.21.15.161:0/484449142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe594004d90 msgr2=0x7fe594005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 --2- 172.21.15.161:0/484449142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe594004d90 0x7fe594005210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00a7a0 tx=0x7fe594005880 comp rx=0 tx=0).stop 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5a92fe700 1 -- 172.21.15.161:0/484449142 reap_dead start 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 -- 172.21.15.161:0/484449142 shutdown_connections 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 -- 172.21.15.161:0/484449142 >> 172.21.15.161:0/484449142 conn(0x7fe5a40cfd70 msgr2=0x7fe5a40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:32:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 -- 172.21.15.161:0/484449142 shutdown_connections 2023-08-10T10:32:39.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.476+0000 7fe5aad61700 1 -- 172.21.15.161:0/484449142 wait complete. 2023-08-10T10:32:39.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.477+0000 7fe5aad61700 1 Processor -- start 2023-08-10T10:32:39.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.477+0000 7fe5aad61700 1 -- start start 2023-08-10T10:32:39.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 0x7fe5a4152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a414d6e0 0x7fe5a414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40b4d50 con 0x7fe5a41555e0 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a414e0a0 con 0x7fe594004d90 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5aad61700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40b41d0 con 0x7fe5a414d6e0 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5a3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5a3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33876/0 (socket says 172.21.15.161:33876) 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.478+0000 7fe5a3fff700 1 -- 172.21.15.161:0/3209168362 learned_addr learned my addr 172.21.15.161:0/3209168362 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a92fe700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a414d6e0 0x7fe5a414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 0x7fe5a4152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 -- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a414d6e0 msgr2=0x7fe5a414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a414d6e0 0x7fe5a414db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 -- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 msgr2=0x7fe5a4152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 0x7fe5a4152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 -- 172.21.15.161:0/3209168362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b44b0 con 0x7fe5a41555e0 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 0x7fe5a4152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:32:39.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a3fff700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe59000f810 tx=0x7fe59000fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900052e0 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590005440 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900038c0 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a40b4790 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.479+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40b3df0 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.480+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a40cd9e0 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.480+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe590003a20 con 0x7fe5a41555e0 2023-08-10T10:32:39.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.481+0000 7fe5a17fa700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 0x7fe58806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.481+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe590089360 con 0x7fe5a41555e0 2023-08-10T10:32:39.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.481+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 0x7fe58806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.481+0000 7fe5a8afd700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 0x7fe58806d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe5a41539c0 tx=0x7fe598008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.485+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe590054480 con 0x7fe5a41555e0 2023-08-10T10:32:39.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.757+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe5a40b3f80 con 0x7fe5a41555e0 2023-08-10T10:32:39.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.758+0000 7fe5a17fa700 1 -- 172.21.15.161:0/3209168362 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fe590057aa0 con 0x7fe5a41555e0 2023-08-10T10:32:39.759 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:32:39.760 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"bbfcd9f5-8a82-457f-9f11-d5cbb0781c1e","modified":"2023-08-10T10:28:04.209071Z","created":"2023-08-10T10:28:04.209071Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-10T10:32:39.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 msgr2=0x7fe58806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 0x7fe58806d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe5a41539c0 tx=0x7fe598008040 comp rx=0 tx=0).stop 2023-08-10T10:32:39.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 msgr2=0x7fe5a406a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe59000f810 tx=0x7fe59000fbd0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 shutdown_connections 2023-08-10T10:32:39.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7fe58806ace0 0x7fe58806d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5a414d6e0 0x7fe5a414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe594004d90 0x7fe5a4152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 --2- 172.21.15.161:0/3209168362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a41555e0 0x7fe5a406a400 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 >> 172.21.15.161:0/3209168362 conn(0x7fe5a40cfd70 msgr2=0x7fe5a415a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:32:39.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 shutdown_connections 2023-08-10T10:32:39.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.760+0000 7fe5aad61700 1 -- 172.21.15.161:0/3209168362 wait complete. 2023-08-10T10:32:39.763 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-08-10T10:32:39.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-08-10T10:32:39.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.923+0000 7f69d681d700 1 Processor -- start 2023-08-10T10:32:39.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.923+0000 7f69d681d700 1 -- start start 2023-08-10T10:32:39.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69d0154620 0x7f69d00717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69d0071d10 0x7f69d006df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d006e480 0x7f69d015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d006e930 con 0x7f69d0071d10 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00c5890 con 0x7f69d0154620 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d681d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d015b290 con 0x7f69d006e480 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69d0071d10 0x7f69d006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69d0071d10 0x7f69d006df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33884/0 (socket says 172.21.15.161:33884) 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 -- 172.21.15.161:0/1449602947 learned_addr learned my addr 172.21.15.161:0/1449602947 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:32:39.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cffff700 1 --2- 172.21.15.161:0/1449602947 >> v2:172.21.15.175:3300/0 conn(0x7f69d0154620 0x7f69d00717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69d4dba700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d006e480 0x7f69d015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 -- 172.21.15.161:0/1449602947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d006e480 msgr2=0x7f69d015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d006e480 0x7f69d015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 -- 172.21.15.161:0/1449602947 >> v2:172.21.15.175:3300/0 conn(0x7f69d0154620 msgr2=0x7f69d00717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/1449602947 >> v2:172.21.15.175:3300/0 conn(0x7f69d0154620 0x7f69d00717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 -- 172.21.15.161:0/1449602947 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d015b570 con 0x7f69d0071d10 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.924+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d0071d10 0x7f69d006df40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69d00671c0 tx=0x7f69c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1acb77c1dd951e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69ceffd700 1 -- 172.21.15.161:0/1449602947 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4011830 con 0x7f69d0071d10 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69ceffd700 1 -- 172.21.15.161:0/1449602947 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4011990 con 0x7f69d0071d10 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69ceffd700 1 -- 172.21.15.161:0/1449602947 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4011d20 con 0x7f69d0071d10 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 -- 172.21.15.161:0/1449602947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d0071d10 msgr2=0x7f69d006df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d0071d10 0x7f69d006df40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69d00671c0 tx=0x7f69c4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 -- 172.21.15.161:0/1449602947 shutdown_connections 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d006e480 0x7f69d015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 --2- 172.21.15.161:0/1449602947 >> v2:172.21.15.175:3300/0 conn(0x7f69d0154620 0x7f69d00717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 --2- 172.21.15.161:0/1449602947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d0071d10 0x7f69d006df40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 -- 172.21.15.161:0/1449602947 >> 172.21.15.161:0/1449602947 conn(0x7f69d00cfd70 msgr2=0x7f69d00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 -- 172.21.15.161:0/1449602947 shutdown_connections 2023-08-10T10:32:39.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.925+0000 7f69d681d700 1 -- 172.21.15.161:0/1449602947 wait complete. 2023-08-10T10:32:39.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.926+0000 7f69d681d700 1 Processor -- start 2023-08-10T10:32:39.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 -- start start 2023-08-10T10:32:39.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d0071d10 0x7f69d014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d0154620 0x7f69d01511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01e5660 con 0x7f69d006e480 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01e50a0 con 0x7f69d0071d10 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69d681d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01e5380 con 0x7f69d0154620 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69cffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69cffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33888/0 (socket says 172.21.15.161:33888) 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.927+0000 7f69cffff700 1 -- 172.21.15.161:0/2768477387 learned_addr learned my addr 172.21.15.161:0/2768477387 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 -- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d0154620 msgr2=0x7f69d01511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d0071d10 0x7f69d014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d0154620 0x7f69d01511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 -- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d0071d10 msgr2=0x7f69d014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d0071d10 0x7f69d014cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 -- 172.21.15.161:0/2768477387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4009550 con 0x7f69d006e480 2023-08-10T10:32:39.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69cffff700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69c000e7f0 tx=0x7f69c000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0009590 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c0013680 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d01f5d50 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c00139f0 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.928+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d014da00 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.929+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d00744e0 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.930+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69c0013b50 con 0x7f69d006e480 2023-08-10T10:32:39.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.930+0000 7f69ccff9700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 0x7f69bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:32:39.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.930+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f69c00893a0 con 0x7f69d006e480 2023-08-10T10:32:39.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.930+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 0x7f69bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:32:39.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.931+0000 7f69cf7fe700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 0x7f69bc06d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69d00cfc50 tx=0x7f69c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:32:39.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:39.935+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f69c0057ed0 con 0x7f69d006e480 2023-08-10T10:32:40.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.219+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f69d00b4da0 con 0x7f69d006e480 2023-08-10T10:32:40.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.219+0000 7f69ccff9700 1 -- 172.21.15.161:0/2768477387 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f69c0057a60 con 0x7f69d006e480 2023-08-10T10:32:40.221 INFO:teuthology.orchestra.run.smithi161.stdout:[client.admin] 2023-08-10T10:32:40.222 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== 2023-08-10T10:32:40.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.221+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 msgr2=0x7f69bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:40.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.221+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 0x7f69bc06d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69d00cfc50 tx=0x7f69c4008030 comp rx=0 tx=0).stop 2023-08-10T10:32:40.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.221+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 msgr2=0x7f69d01f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:32:40.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.221+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69c000e7f0 tx=0x7f69c000ebb0 comp rx=0 tx=0).stop 2023-08-10T10:32:40.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 shutdown_connections 2023-08-10T10:32:40.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:6832/4243192540,v1:172.21.15.161:6833/4243192540] conn(0x7f69bc06ace0 0x7f69bc06d1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:40.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69d0154620 0x7f69d01511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:40.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69d006e480 0x7f69d01f6550 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:40.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 --2- 172.21.15.161:0/2768477387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d0071d10 0x7f69d014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:32:40.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 >> 172.21.15.161:0/2768477387 conn(0x7f69d00cfd70 msgr2=0x7f69d00b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:32:40.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 shutdown_connections 2023-08-10T10:32:40.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-08-10T10:32:40.222+0000 7f69d681d700 1 -- 172.21.15.161:0/2768477387 wait complete. 2023-08-10T10:32:40.235 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:32:40.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/tmp/tmp.arJpumkS1bxfstests-dev/local.config 2023-08-10T10:32:40.295 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.161:6789:/test export TEST_DIR=/tmp/tmp.nl7OU3OXQatest export SCRATCH_DEV=172.21.15.161:6789:/scratch export SCRATCH_MNT=/tmp/tmp.crTtBIQgBvscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw==" 2023-08-10T10:32:40.295 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T10:32:40.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/tmp/tmp.arJpumkS1bxfstests-dev/ceph.exclude 2023-08-10T10:32:40.361 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo make) 2023-08-10T10:32:40.442 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize -cfi 2023-08-10T10:32:40.756 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-10T10:32:40.756 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file './config.guess' 2023-08-10T10:32:40.759 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file './config.sub' 2023-08-10T10:32:40.762 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file './install-sh' 2023-08-10T10:32:40.766 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file './ltmain.sh' 2023-08-10T10:32:40.786 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-10T10:32:40.787 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-10T10:32:40.791 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-10T10:32:40.795 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-10T10:32:40.799 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-10T10:32:40.803 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-10T10:32:40.809 INFO:teuthology.orchestra.run.smithi161.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-10T10:32:40.810 INFO:teuthology.orchestra.run.smithi161.stdout:cp include/install-sh . 2023-08-10T10:32:40.811 INFO:teuthology.orchestra.run.smithi161.stdout:aclocal -I m4 2023-08-10T10:32:41.983 INFO:teuthology.orchestra.run.smithi161.stdout:autoheader 2023-08-10T10:32:42.282 INFO:teuthology.orchestra.run.smithi161.stdout:autoconf 2023-08-10T10:32:42.443 INFO:teuthology.orchestra.run.smithi161.stdout:./configure \ 2023-08-10T10:32:42.444 INFO:teuthology.orchestra.run.smithi161.stdout: --libexecdir=/usr/lib \ 2023-08-10T10:32:42.444 INFO:teuthology.orchestra.run.smithi161.stdout: --exec_prefix=/var/lib 2023-08-10T10:32:42.902 INFO:teuthology.orchestra.run.smithi161.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-10T10:32:42.902 INFO:teuthology.orchestra.run.smithi161.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-10T10:32:42.903 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to print strings... printf 2023-08-10T10:32:42.904 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gcc... gcc 2023-08-10T10:32:43.005 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether the C compiler works... yes 2023-08-10T10:32:43.005 INFO:teuthology.orchestra.run.smithi161.stdout:checking for C compiler default output file name... a.out 2023-08-10T10:32:43.033 INFO:teuthology.orchestra.run.smithi161.stdout:checking for suffix of executables... 2023-08-10T10:32:43.076 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether we are cross compiling... no 2023-08-10T10:32:43.093 INFO:teuthology.orchestra.run.smithi161.stdout:checking for suffix of object files... o 2023-08-10T10:32:43.109 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether we are using the GNU C compiler... yes 2023-08-10T10:32:43.125 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether gcc accepts -g... yes 2023-08-10T10:32:43.151 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-10T10:32:43.154 INFO:teuthology.orchestra.run.smithi161.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-10T10:32:43.156 INFO:teuthology.orchestra.run.smithi161.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-10T10:32:43.157 INFO:teuthology.orchestra.run.smithi161.stdout:checking for egrep... /bin/grep -E 2023-08-10T10:32:43.158 INFO:teuthology.orchestra.run.smithi161.stdout:checking for fgrep... /bin/grep -F 2023-08-10T10:32:43.161 INFO:teuthology.orchestra.run.smithi161.stdout:checking for ld used by gcc... /bin/ld 2023-08-10T10:32:43.163 INFO:teuthology.orchestra.run.smithi161.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-10T10:32:43.172 INFO:teuthology.orchestra.run.smithi161.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-10T10:32:43.187 INFO:teuthology.orchestra.run.smithi161.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-10T10:32:43.188 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether ln -s works... yes 2023-08-10T10:32:43.196 INFO:teuthology.orchestra.run.smithi161.stdout:checking the maximum length of command line arguments... 1572864 2023-08-10T10:32:43.198 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-10T10:32:43.199 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-10T10:32:43.199 INFO:teuthology.orchestra.run.smithi161.stdout:checking for /bin/ld option to reload object files... -r 2023-08-10T10:32:43.199 INFO:teuthology.orchestra.run.smithi161.stdout:checking for objdump... objdump 2023-08-10T10:32:43.199 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to recognize dependent libraries... pass_all 2023-08-10T10:32:43.200 INFO:teuthology.orchestra.run.smithi161.stdout:checking for dlltool... no 2023-08-10T10:32:43.200 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-10T10:32:43.201 INFO:teuthology.orchestra.run.smithi161.stdout:checking for ar... ar 2023-08-10T10:32:43.224 INFO:teuthology.orchestra.run.smithi161.stdout:checking for archiver @FILE support... @ 2023-08-10T10:32:43.224 INFO:teuthology.orchestra.run.smithi161.stdout:checking for strip... strip 2023-08-10T10:32:43.225 INFO:teuthology.orchestra.run.smithi161.stdout:checking for ranlib... ranlib 2023-08-10T10:32:43.225 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gawk... gawk 2023-08-10T10:32:43.275 INFO:teuthology.orchestra.run.smithi161.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-10T10:32:43.276 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sysroot... no 2023-08-10T10:32:43.278 INFO:teuthology.orchestra.run.smithi161.stdout:checking for a working dd... /bin/dd 2023-08-10T10:32:43.281 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-10T10:32:43.293 INFO:teuthology.orchestra.run.smithi161.stdout:checking for mt... no 2023-08-10T10:32:43.295 INFO:teuthology.orchestra.run.smithi161.stdout:checking if : is a manifest tool... no 2023-08-10T10:32:43.323 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to run the C preprocessor... gcc -E 2023-08-10T10:32:43.436 INFO:teuthology.orchestra.run.smithi161.stdout:checking for ANSI C header files... yes 2023-08-10T10:32:43.455 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/types.h... yes 2023-08-10T10:32:43.480 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/stat.h... yes 2023-08-10T10:32:43.502 INFO:teuthology.orchestra.run.smithi161.stdout:checking for stdlib.h... yes 2023-08-10T10:32:43.526 INFO:teuthology.orchestra.run.smithi161.stdout:checking for string.h... yes 2023-08-10T10:32:43.550 INFO:teuthology.orchestra.run.smithi161.stdout:checking for memory.h... yes 2023-08-10T10:32:43.574 INFO:teuthology.orchestra.run.smithi161.stdout:checking for strings.h... yes 2023-08-10T10:32:43.600 INFO:teuthology.orchestra.run.smithi161.stdout:checking for inttypes.h... yes 2023-08-10T10:32:43.624 INFO:teuthology.orchestra.run.smithi161.stdout:checking for stdint.h... yes 2023-08-10T10:32:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:checking for unistd.h... yes 2023-08-10T10:32:43.676 INFO:teuthology.orchestra.run.smithi161.stdout:checking for dlfcn.h... yes 2023-08-10T10:32:43.679 INFO:teuthology.orchestra.run.smithi161.stdout:checking for objdir... .libs 2023-08-10T10:32:43.743 INFO:teuthology.orchestra.run.smithi161.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-10T10:32:43.743 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-10T10:32:43.759 INFO:teuthology.orchestra.run.smithi161.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-10T10:32:43.778 INFO:teuthology.orchestra.run.smithi161.stdout:checking if gcc static flag -static works... no 2023-08-10T10:32:43.798 INFO:teuthology.orchestra.run.smithi161.stdout:checking if gcc supports -c -o file.o... yes 2023-08-10T10:32:43.798 INFO:teuthology.orchestra.run.smithi161.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-10T10:32:43.804 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-10T10:32:43.828 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether -lc should be explicitly linked in... no 2023-08-10T10:32:43.870 INFO:teuthology.orchestra.run.smithi161.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-10T10:32:43.870 INFO:teuthology.orchestra.run.smithi161.stdout:checking how to hardcode library paths into programs... immediate 2023-08-10T10:32:43.878 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether stripping libraries is possible... yes 2023-08-10T10:32:43.879 INFO:teuthology.orchestra.run.smithi161.stdout:checking if libtool supports shared libraries... yes 2023-08-10T10:32:43.879 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether to build shared libraries... yes 2023-08-10T10:32:43.879 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether to build static libraries... yes 2023-08-10T10:32:43.883 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gcc... (cached) gcc 2023-08-10T10:32:43.898 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-10T10:32:43.898 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-10T10:32:43.899 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-10T10:32:43.899 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gmake... /usr/bin/gmake 2023-08-10T10:32:43.899 INFO:teuthology.orchestra.run.smithi161.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-08-10T10:32:43.900 INFO:teuthology.orchestra.run.smithi161.stdout:checking for tar... /bin/tar 2023-08-10T10:32:43.900 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gzip... /bin/gzip 2023-08-10T10:32:43.906 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether gcc -MM is supported... yes 2023-08-10T10:32:43.907 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sort... /bin/sort 2023-08-10T10:32:43.907 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether ln -s works... yes 2023-08-10T10:32:43.907 INFO:teuthology.orchestra.run.smithi161.stdout:checking for rpm... /bin/rpm 2023-08-10T10:32:43.910 INFO:teuthology.orchestra.run.smithi161.stdout:checking for rpmbuild... no 2023-08-10T10:32:43.935 INFO:teuthology.orchestra.run.smithi161.stdout:checking assert.h usability... yes 2023-08-10T10:32:43.941 INFO:teuthology.orchestra.run.smithi161.stdout:checking assert.h presence... yes 2023-08-10T10:32:43.941 INFO:teuthology.orchestra.run.smithi161.stdout:checking for assert.h... yes 2023-08-10T10:32:43.967 INFO:teuthology.orchestra.run.smithi161.stdout:checking bstring.h usability... no 2023-08-10T10:32:43.976 INFO:teuthology.orchestra.run.smithi161.stdout:checking bstring.h presence... no 2023-08-10T10:32:43.976 INFO:teuthology.orchestra.run.smithi161.stdout:checking for bstring.h... no 2023-08-10T10:32:44.000 INFO:teuthology.orchestra.run.smithi161.stdout:checking libgen.h usability... yes 2023-08-10T10:32:44.006 INFO:teuthology.orchestra.run.smithi161.stdout:checking libgen.h presence... yes 2023-08-10T10:32:44.007 INFO:teuthology.orchestra.run.smithi161.stdout:checking for libgen.h... yes 2023-08-10T10:32:44.034 INFO:teuthology.orchestra.run.smithi161.stdout:checking dirent.h usability... yes 2023-08-10T10:32:44.041 INFO:teuthology.orchestra.run.smithi161.stdout:checking dirent.h presence... yes 2023-08-10T10:32:44.041 INFO:teuthology.orchestra.run.smithi161.stdout:checking for dirent.h... yes 2023-08-10T10:32:44.086 INFO:teuthology.orchestra.run.smithi161.stdout:checking errno.h usability... yes 2023-08-10T10:32:44.093 INFO:teuthology.orchestra.run.smithi161.stdout:checking errno.h presence... yes 2023-08-10T10:32:44.093 INFO:teuthology.orchestra.run.smithi161.stdout:checking for errno.h... yes 2023-08-10T10:32:44.120 INFO:teuthology.orchestra.run.smithi161.stdout:checking malloc.h usability... yes 2023-08-10T10:32:44.129 INFO:teuthology.orchestra.run.smithi161.stdout:checking malloc.h presence... yes 2023-08-10T10:32:44.129 INFO:teuthology.orchestra.run.smithi161.stdout:checking for malloc.h... yes 2023-08-10T10:32:44.154 INFO:teuthology.orchestra.run.smithi161.stdout:checking uuid.h usability... no 2023-08-10T10:32:44.164 INFO:teuthology.orchestra.run.smithi161.stdout:checking uuid.h presence... no 2023-08-10T10:32:44.164 INFO:teuthology.orchestra.run.smithi161.stdout:checking for uuid.h... no 2023-08-10T10:32:44.190 INFO:teuthology.orchestra.run.smithi161.stdout:checking uuid/uuid.h usability... yes 2023-08-10T10:32:44.198 INFO:teuthology.orchestra.run.smithi161.stdout:checking uuid/uuid.h presence... yes 2023-08-10T10:32:44.198 INFO:teuthology.orchestra.run.smithi161.stdout:checking for uuid/uuid.h... yes 2023-08-10T10:32:44.224 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/uuid.h usability... no 2023-08-10T10:32:44.233 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/uuid.h presence... no 2023-08-10T10:32:44.233 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/uuid.h... no 2023-08-10T10:32:44.259 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/file.h usability... yes 2023-08-10T10:32:44.266 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/file.h presence... yes 2023-08-10T10:32:44.266 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/file.h... yes 2023-08-10T10:32:44.293 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fcntl.h usability... yes 2023-08-10T10:32:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fcntl.h presence... yes 2023-08-10T10:32:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/fcntl.h... yes 2023-08-10T10:32:44.325 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/syssgi.h usability... no 2023-08-10T10:32:44.341 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/syssgi.h presence... no 2023-08-10T10:32:44.341 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/syssgi.h... no 2023-08-10T10:32:44.443 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/param.h usability... yes 2023-08-10T10:32:44.452 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/param.h presence... yes 2023-08-10T10:32:44.453 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/param.h... yes 2023-08-10T10:32:44.457 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/stat.h... (cached) yes 2023-08-10T10:32:44.485 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/statvfs.h usability... yes 2023-08-10T10:32:44.491 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/statvfs.h presence... yes 2023-08-10T10:32:44.492 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/statvfs.h... yes 2023-08-10T10:32:44.517 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/time.h usability... yes 2023-08-10T10:32:44.524 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/time.h presence... yes 2023-08-10T10:32:44.525 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/time.h... yes 2023-08-10T10:32:44.576 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/ioctl.h usability... yes 2023-08-10T10:32:44.583 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/ioctl.h presence... yes 2023-08-10T10:32:44.584 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/ioctl.h... yes 2023-08-10T10:32:44.613 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/wait.h usability... yes 2023-08-10T10:32:44.621 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/wait.h presence... yes 2023-08-10T10:32:44.622 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/wait.h... yes 2023-08-10T10:32:44.626 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/types.h... (cached) yes 2023-08-10T10:32:44.631 INFO:teuthology.orchestra.run.smithi161.stdout:checking for strings.h... (cached) yes 2023-08-10T10:32:44.672 INFO:teuthology.orchestra.run.smithi161.stdout:checking err.h usability... yes 2023-08-10T10:32:44.679 INFO:teuthology.orchestra.run.smithi161.stdout:checking err.h presence... yes 2023-08-10T10:32:44.679 INFO:teuthology.orchestra.run.smithi161.stdout:checking for err.h... yes 2023-08-10T10:32:44.705 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/falloc.h usability... yes 2023-08-10T10:32:44.711 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/falloc.h presence... yes 2023-08-10T10:32:44.712 INFO:teuthology.orchestra.run.smithi161.stdout:checking for linux/falloc.h... yes 2023-08-10T10:32:44.737 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-10T10:32:44.746 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-10T10:32:44.746 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-10T10:32:44.768 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-10T10:32:44.778 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-10T10:32:44.779 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-10T10:32:44.800 INFO:teuthology.orchestra.run.smithi161.stdout:checking xfs/platform_defs.h usability... no 2023-08-10T10:32:44.810 INFO:teuthology.orchestra.run.smithi161.stdout:checking xfs/platform_defs.h presence... no 2023-08-10T10:32:44.810 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/platform_defs.h... no 2023-08-10T10:32:44.832 INFO:teuthology.orchestra.run.smithi161.stdout:checking btrfs/ioctl.h usability... no 2023-08-10T10:32:44.842 INFO:teuthology.orchestra.run.smithi161.stdout:checking btrfs/ioctl.h presence... no 2023-08-10T10:32:44.842 INFO:teuthology.orchestra.run.smithi161.stdout:checking for btrfs/ioctl.h... no 2023-08-10T10:32:44.865 INFO:teuthology.orchestra.run.smithi161.stdout:checking cifs/ioctl.h usability... no 2023-08-10T10:32:44.874 INFO:teuthology.orchestra.run.smithi161.stdout:checking cifs/ioctl.h presence... no 2023-08-10T10:32:44.874 INFO:teuthology.orchestra.run.smithi161.stdout:checking for cifs/ioctl.h... no 2023-08-10T10:32:44.899 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/mman.h usability... yes 2023-08-10T10:32:44.906 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/mman.h presence... yes 2023-08-10T10:32:44.906 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/mman.h... yes 2023-08-10T10:32:44.920 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/xfs_log_format.h... no 2023-08-10T10:32:44.954 INFO:teuthology.orchestra.run.smithi161.stdout:checking for uuid_compare... no 2023-08-10T10:32:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:checking for uuid_compare in -luuid... yes 2023-08-10T10:32:45.040 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/xfs.h... yes 2023-08-10T10:32:45.053 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/libxfs.h... no 2023-08-10T10:32:45.068 INFO:teuthology.orchestra.run.smithi161.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-10T10:32:45.095 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/xqm.h... yes 2023-08-10T10:32:45.139 INFO:teuthology.orchestra.run.smithi161.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-10T10:32:45.161 INFO:teuthology.orchestra.run.smithi161.stdout:checking xfs/handle.h usability... yes 2023-08-10T10:32:45.167 INFO:teuthology.orchestra.run.smithi161.stdout:checking xfs/handle.h presence... yes 2023-08-10T10:32:45.167 INFO:teuthology.orchestra.run.smithi161.stdout:checking for xfs/handle.h... yes 2023-08-10T10:32:45.202 INFO:teuthology.orchestra.run.smithi161.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-10T10:32:45.228 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/acl.h usability... yes 2023-08-10T10:32:45.236 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/acl.h presence... yes 2023-08-10T10:32:45.236 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/acl.h... yes 2023-08-10T10:32:45.263 INFO:teuthology.orchestra.run.smithi161.stdout:checking acl/libacl.h usability... yes 2023-08-10T10:32:45.270 INFO:teuthology.orchestra.run.smithi161.stdout:checking acl/libacl.h presence... yes 2023-08-10T10:32:45.271 INFO:teuthology.orchestra.run.smithi161.stdout:checking for acl/libacl.h... yes 2023-08-10T10:32:45.301 INFO:teuthology.orchestra.run.smithi161.stdout:checking for acl_init in -lacl... yes 2023-08-10T10:32:45.323 INFO:teuthology.orchestra.run.smithi161.stdout:checking gdbm-ndbm.h usability... no 2023-08-10T10:32:45.333 INFO:teuthology.orchestra.run.smithi161.stdout:checking gdbm-ndbm.h presence... no 2023-08-10T10:32:45.333 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gdbm-ndbm.h... no 2023-08-10T10:32:45.353 INFO:teuthology.orchestra.run.smithi161.stdout:checking gdbm/ndbm.h usability... no 2023-08-10T10:32:45.376 INFO:teuthology.orchestra.run.smithi161.stdout:checking gdbm/ndbm.h presence... no 2023-08-10T10:32:45.376 INFO:teuthology.orchestra.run.smithi161.stdout:checking for gdbm/ndbm.h... no 2023-08-10T10:32:45.397 INFO:teuthology.orchestra.run.smithi161.stdout:checking ndbm.h usability... no 2023-08-10T10:32:45.406 INFO:teuthology.orchestra.run.smithi161.stdout:checking ndbm.h presence... no 2023-08-10T10:32:45.406 INFO:teuthology.orchestra.run.smithi161.stdout:checking for ndbm.h... no 2023-08-10T10:32:45.431 INFO:teuthology.orchestra.run.smithi161.stdout:checking libaio.h usability... yes 2023-08-10T10:32:45.440 INFO:teuthology.orchestra.run.smithi161.stdout:checking libaio.h presence... yes 2023-08-10T10:32:45.441 INFO:teuthology.orchestra.run.smithi161.stdout:checking for libaio.h... yes 2023-08-10T10:32:45.462 INFO:teuthology.orchestra.run.smithi161.stdout:checking liburing.h usability... no 2023-08-10T10:32:45.472 INFO:teuthology.orchestra.run.smithi161.stdout:checking liburing.h presence... no 2023-08-10T10:32:45.472 INFO:teuthology.orchestra.run.smithi161.stdout:checking for liburing.h... no 2023-08-10T10:32:45.492 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/capability.h usability... no 2023-08-10T10:32:45.502 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/capability.h presence... no 2023-08-10T10:32:45.502 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/capability.h... no 2023-08-10T10:32:45.524 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/fiemap.h usability... yes 2023-08-10T10:32:45.531 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/fiemap.h presence... yes 2023-08-10T10:32:45.531 INFO:teuthology.orchestra.run.smithi161.stdout:checking for linux/fiemap.h... yes 2023-08-10T10:32:45.563 INFO:teuthology.orchestra.run.smithi161.stdout:checking for fallocate... yes 2023-08-10T10:32:45.595 INFO:teuthology.orchestra.run.smithi161.stdout:checking for open_by_handle_at... yes 2023-08-10T10:32:45.619 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/prctl.h usability... yes 2023-08-10T10:32:45.626 INFO:teuthology.orchestra.run.smithi161.stdout:checking sys/prctl.h presence... yes 2023-08-10T10:32:45.627 INFO:teuthology.orchestra.run.smithi161.stdout:checking for sys/prctl.h... yes 2023-08-10T10:32:45.650 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/fs.h usability... yes 2023-08-10T10:32:45.656 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/fs.h presence... yes 2023-08-10T10:32:45.657 INFO:teuthology.orchestra.run.smithi161.stdout:checking for linux/fs.h... yes 2023-08-10T10:32:45.677 INFO:teuthology.orchestra.run.smithi161.stdout:checking btrfsutil.h usability... no 2023-08-10T10:32:45.686 INFO:teuthology.orchestra.run.smithi161.stdout:checking btrfsutil.h presence... no 2023-08-10T10:32:45.687 INFO:teuthology.orchestra.run.smithi161.stdout:checking for btrfsutil.h... no 2023-08-10T10:32:45.720 INFO:teuthology.orchestra.run.smithi161.stdout:checking for copy_file_range... yes 2023-08-10T10:32:45.754 INFO:teuthology.orchestra.run.smithi161.stdout:checking for SEEK_DATA... yes 2023-08-10T10:32:45.798 INFO:teuthology.orchestra.run.smithi161.stdout:checking for BMV_OF_SHARED... yes 2023-08-10T10:32:45.832 INFO:teuthology.orchestra.run.smithi161.stdout:checking for nftw... yes 2023-08-10T10:32:45.866 INFO:teuthology.orchestra.run.smithi161.stdout:checking for RLIMIT_NOFILE... yes 2023-08-10T10:32:45.883 INFO:teuthology.orchestra.run.smithi161.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-10T10:32:45.914 INFO:teuthology.orchestra.run.smithi161.stdout:checking for renameat2... yes 2023-08-10T10:32:45.945 INFO:teuthology.orchestra.run.smithi161.stdout:checking for reallocarray... yes 2023-08-10T10:32:45.959 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct mount_attr... no 2023-08-10T10:32:46.003 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-10T10:32:46.036 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-10T10:32:46.070 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-10T10:32:46.102 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-10T10:32:46.135 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-10T10:32:46.169 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-10T10:32:46.202 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-10T10:32:46.227 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/btrfs.h usability... yes 2023-08-10T10:32:46.234 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/btrfs.h presence... yes 2023-08-10T10:32:46.234 INFO:teuthology.orchestra.run.smithi161.stdout:checking for linux/btrfs.h... yes 2023-08-10T10:32:46.263 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-10T10:32:46.270 INFO:teuthology.orchestra.run.smithi161.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-10T10:32:46.271 INFO:teuthology.orchestra.run.smithi161.stdout:checking for linux/btrfs_tree.h... yes 2023-08-10T10:32:46.300 INFO:teuthology.orchestra.run.smithi161.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-08-10T10:32:46.316 INFO:teuthology.orchestra.run.smithi161.stdout:configure: creating ./config.status 2023-08-10T10:32:46.608 INFO:teuthology.orchestra.run.smithi161.stdout:config.status: creating include/builddefs 2023-08-10T10:32:46.618 INFO:teuthology.orchestra.run.smithi161.stdout:config.status: creating include/config.h 2023-08-10T10:32:46.626 INFO:teuthology.orchestra.run.smithi161.stdout:config.status: executing libtool commands 2023-08-10T10:32:46.662 INFO:teuthology.orchestra.run.smithi161.stdout:Building include 2023-08-10T10:32:46.665 INFO:teuthology.orchestra.run.smithi161.stdout:Building lib 2023-08-10T10:32:46.668 INFO:teuthology.orchestra.run.smithi161.stdout: [LTDEP] 2023-08-10T10:32:46.771 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dataascii.lo 2023-08-10T10:32:46.883 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] databin.lo 2023-08-10T10:32:47.020 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] datapid.lo 2023-08-10T10:32:47.115 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] file_lock.lo 2023-08-10T10:32:47.250 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] forker.lo 2023-08-10T10:32:47.373 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] pattern.lo 2023-08-10T10:32:47.487 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] open_flags.lo 2023-08-10T10:32:47.618 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] random_range.lo 2023-08-10T10:32:47.826 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] string_to_tokens.lo 2023-08-10T10:32:47.922 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] str_to_bytes.lo 2023-08-10T10:32:48.043 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] tlibio.lo 2023-08-10T10:32:48.253 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] write_log.lo 2023-08-10T10:32:48.471 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] random.lo 2023-08-10T10:32:48.578 INFO:teuthology.orchestra.run.smithi161.stdout: [LD] 2023-08-10T10:32:48.647 INFO:teuthology.orchestra.run.smithi161.stdout:Building ltp 2023-08-10T10:32:48.649 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:48.767 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] doio 2023-08-10T10:32:49.354 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fsstress 2023-08-10T10:32:50.541 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fsx 2023-08-10T10:32:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] growfiles 2023-08-10T10:32:51.780 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] iogen 2023-08-10T10:32:52.099 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-stress 2023-08-10T10:32:52.475 INFO:teuthology.orchestra.run.smithi161.stdout:Building src 2023-08-10T10:32:52.480 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:53.768 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:53.793 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:53.800 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:53.977 INFO:teuthology.orchestra.run.smithi161.stdout: [DEP] 2023-08-10T10:32:53.998 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dirstress 2023-08-10T10:32:54.210 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fill 2023-08-10T10:32:54.351 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fill2 2023-08-10T10:32:54.554 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] getpagesize 2023-08-10T10:32:54.679 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] holes 2023-08-10T10:32:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] lstat64 2023-08-10T10:32:55.019 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] nametest 2023-08-10T10:32:55.232 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] permname 2023-08-10T10:32:55.411 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] randholes 2023-08-10T10:32:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] runas 2023-08-10T10:32:55.791 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] truncfile 2023-08-10T10:32:55.952 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] usemem 2023-08-10T10:32:56.089 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] mmapcat 2023-08-10T10:32:56.224 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] append_reader 2023-08-10T10:32:56.377 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] append_writer 2023-08-10T10:32:56.514 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dirperf 2023-08-10T10:32:56.711 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] metaperf 2023-08-10T10:32:56.939 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] devzero 2023-08-10T10:32:57.097 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] feature 2023-08-10T10:32:57.290 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] alloc 2023-08-10T10:32:57.480 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fault 2023-08-10T10:32:57.627 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fstest 2023-08-10T10:32:57.839 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_access_root 2023-08-10T10:32:57.979 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] godown 2023-08-10T10:32:58.131 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] resvtest 2023-08-10T10:32:58.299 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] writemod 2023-08-10T10:32:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] writev_on_pagefault 2023-08-10T10:32:58.577 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] makeextents 2023-08-10T10:32:58.739 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] itrash 2023-08-10T10:32:58.880 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] rename 2023-08-10T10:32:59.008 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] multi_open_unlink 2023-08-10T10:32:59.159 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] unwritten_sync 2023-08-10T10:32:59.321 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] genhashnames 2023-08-10T10:32:59.493 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_holes 2023-08-10T10:32:59.628 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_writev 2023-08-10T10:32:59.764 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_truncate_cmtime 2023-08-10T10:32:59.908 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dirhash_collide 2023-08-10T10:33:00.072 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_rename_overwrite 2023-08-10T10:33:00.202 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] holetest 2023-08-10T10:33:00.400 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_truncate_self 2023-08-10T10:33:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] af_unix 2023-08-10T10:33:00.668 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_stale_pmd 2023-08-10T10:33:00.808 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_cow_race 2023-08-10T10:33:00.957 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_fallocate 2023-08-10T10:33:01.096 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fsync-err 2023-08-10T10:33:01.263 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_write_ro 2023-08-10T10:33:01.400 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-10T10:33:01.544 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-10T10:33:01.685 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_ofd_locks 2023-08-10T10:33:01.867 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_collision 2023-08-10T10:33:02.047 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] mmap-write-concurrent 2023-08-10T10:33:02.201 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_get_file_time 2023-08-10T10:33:02.337 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_create_short_dirs 2023-08-10T10:33:02.488 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_create_long_dirs 2023-08-10T10:33:02.637 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_enospc 2023-08-10T10:33:02.806 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_writev_overlap 2023-08-10T10:33:02.960 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] checkpoint_journal 2023-08-10T10:33:03.101 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] mmap-rw-fault 2023-08-10T10:33:03.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:03.238 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:03.271 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] allocstale 2023-08-10T10:33:03.424 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_cow_memory_failure 2023-08-10T10:33:03.578 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fake-dump-rootino 2023-08-10T10:33:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dio-buf-fault 2023-08-10T10:33:03.857 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] xfsctl 2023-08-10T10:33:04.026 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] bstat 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mtab 2023-08-10T10:33:04.376 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] getdevicesize 2023-08-10T10:33:04.506 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] preallo_rw_pattern_reader 2023-08-10T10:33:04.650 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] preallo_rw_pattern_writer 2023-08-10T10:33:04.794 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] ftrunc 2023-08-10T10:33:04.930 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] trunc 2023-08-10T10:33:05.077 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fs_perms 2023-08-10T10:33:05.226 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] testx 2023-08-10T10:33:05.354 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] looptest 2023-08-10T10:33:05.529 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] locktest 2023-08-10T10:33:05.805 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] unwritten_mmap 2023-08-10T10:33:05.953 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] bulkstat_unlink_test 2023-08-10T10:33:06.134 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] deduperace 2023-08-10T10:33:06.310 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] bulkstat_unlink_test_modified 2023-08-10T10:33:06.487 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_dir_offset 2023-08-10T10:33:06.623 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_futimens 2023-08-10T10:33:06.753 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_immutable 2023-08-10T10:33:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] stale_handle 2023-08-10T10:33:07.451 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] pwrite_mmap_blocked 2023-08-10T10:33:07.593 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_dir_offset2 2023-08-10T10:33:07.768 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] seek_sanity_test 2023-08-10T10:33:08.139 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] seek_copy_test 2023-08-10T10:33:08.301 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_readdir_1 2023-08-10T10:33:08.437 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_readdir_2 2023-08-10T10:33:08.576 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fsync-tester 2023-08-10T10:33:08.800 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] nsexec 2023-08-10T10:33:08.961 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] cloner 2023-08-10T10:33:09.123 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] renameat2 2023-08-10T10:33:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_getcwd 2023-08-10T10:33:09.418 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] e4compact 2023-08-10T10:33:09.599 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] test-nextquota 2023-08-10T10:33:09.753 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] punch-alternating 2023-08-10T10:33:09.907 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-10T10:33:10.058 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] listxattr 2023-08-10T10:33:10.193 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dio-interleaved 2023-08-10T10:33:10.339 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_dir_type 2023-08-10T10:33:10.483 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] dio-invalidate-cache 2023-08-10T10:33:10.667 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] stat_test 2023-08-10T10:33:10.935 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_encrypted_d_revalidate 2023-08-10T10:33:11.206 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] attr_replace_test 2023-08-10T10:33:11.354 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] swapon 2023-08-10T10:33:11.504 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] mkswap 2023-08-10T10:33:11.644 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_attr_corruption 2023-08-10T10:33:11.781 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_open_tmpfiles 2023-08-10T10:33:11.943 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fscrypt-crypt-util 2023-08-10T10:33:12.516 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] bulkstat_null_ocount 2023-08-10T10:33:12.660 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] splice-test 2023-08-10T10:33:12.824 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] chprojid_fail 2023-08-10T10:33:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] detached_mounts_propagation 2023-08-10T10:33:13.138 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] ext4_resize 2023-08-10T10:33:13.274 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_readdir_3 2023-08-10T10:33:13.450 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] splice2pipe 2023-08-10T10:33:13.601 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] uuid_ioctl 2023-08-10T10:33:13.742 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fiemap-tester 2023-08-10T10:33:13.982 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_stripealign 2023-08-10T10:33:14.123 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] open_by_handle 2023-08-10T10:33:14.353 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] t_mmap_dio 2023-08-10T10:33:14.502 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] xfsfind 2023-08-10T10:33:14.676 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] fssum 2023-08-10T10:33:15.064 INFO:teuthology.orchestra.run.smithi161.stdout:Building log-writes 2023-08-10T10:33:15.069 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] replay-log 2023-08-10T10:33:15.347 INFO:teuthology.orchestra.run.smithi161.stdout:Building perf 2023-08-10T10:33:15.351 INFO:teuthology.orchestra.run.smithi161.stdout:Building aio-dio-regress 2023-08-10T10:33:15.357 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-10T10:33:15.519 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-fcntl-race 2023-08-10T10:33:15.670 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-subblock-eof-read 2023-08-10T10:33:15.805 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-append-write-read-race 2023-08-10T10:33:15.968 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-invalidate-readahead 2023-08-10T10:33:16.120 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-write-verify 2023-08-10T10:33:16.297 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-10T10:33:16.425 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-last-ref-held-by-io 2023-08-10T10:33:16.585 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-cycle-write 2023-08-10T10:33:16.755 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-extend-stat 2023-08-10T10:33:16.909 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-10T10:33:17.035 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-hole-filling-race 2023-08-10T10:33:17.175 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-invalidate-failure 2023-08-10T10:33:17.324 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aiodio_sparse2 2023-08-10T10:33:17.523 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aiocp 2023-08-10T10:33:17.728 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-cow-race 2023-08-10T10:33:17.872 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] aio-dio-eof-race 2023-08-10T10:33:18.042 INFO:teuthology.orchestra.run.smithi161.stdout:Building vfs 2023-08-10T10:33:18.047 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] vfstest 2023-08-10T10:33:19.712 INFO:teuthology.orchestra.run.smithi161.stdout: [CC] mount-idmapped 2023-08-10T10:33:20.038 INFO:teuthology.orchestra.run.smithi161.stdout:Building m4 2023-08-10T10:33:20.042 INFO:teuthology.orchestra.run.smithi161.stdout:Building common 2023-08-10T10:33:20.045 INFO:teuthology.orchestra.run.smithi161.stdout:Building tests 2023-08-10T10:33:20.050 INFO:teuthology.orchestra.run.smithi161.stdout:Building perf 2023-08-10T10:33:20.055 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/perf/group.list 2023-08-10T10:33:20.065 INFO:teuthology.orchestra.run.smithi161.stdout:Building ext4 2023-08-10T10:33:20.070 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ext4/group.list 2023-08-10T10:33:20.103 INFO:teuthology.orchestra.run.smithi161.stdout:Building ocfs2 2023-08-10T10:33:20.107 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ocfs2/group.list 2023-08-10T10:33:20.119 INFO:teuthology.orchestra.run.smithi161.stdout:Building overlay 2023-08-10T10:33:20.124 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/overlay/group.list 2023-08-10T10:33:20.159 INFO:teuthology.orchestra.run.smithi161.stdout:Building cifs 2023-08-10T10:33:20.164 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/cifs/group.list 2023-08-10T10:33:20.175 INFO:teuthology.orchestra.run.smithi161.stdout:Building generic 2023-08-10T10:33:20.181 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/generic/group.list 2023-08-10T10:33:20.269 INFO:teuthology.orchestra.run.smithi161.stdout:Building shared 2023-08-10T10:33:20.273 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/shared/group.list 2023-08-10T10:33:20.288 INFO:teuthology.orchestra.run.smithi161.stdout:Building nfs 2023-08-10T10:33:20.293 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/nfs/group.list 2023-08-10T10:33:20.306 INFO:teuthology.orchestra.run.smithi161.stdout:Building f2fs 2023-08-10T10:33:20.311 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/f2fs/group.list 2023-08-10T10:33:20.325 INFO:teuthology.orchestra.run.smithi161.stdout:Building udf 2023-08-10T10:33:20.330 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/udf/group.list 2023-08-10T10:33:20.341 INFO:teuthology.orchestra.run.smithi161.stdout:Building ceph 2023-08-10T10:33:20.345 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ceph/group.list 2023-08-10T10:33:20.358 INFO:teuthology.orchestra.run.smithi161.stdout:Building xfs 2023-08-10T10:33:20.364 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/xfs/group.list 2023-08-10T10:33:20.453 INFO:teuthology.orchestra.run.smithi161.stdout:Building btrfs 2023-08-10T10:33:20.458 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/btrfs/group.list 2023-08-10T10:33:20.511 INFO:teuthology.orchestra.run.smithi161.stdout:Building tmpfs 2023-08-10T10:33:20.516 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/tmpfs/group.list 2023-08-10T10:33:20.528 INFO:teuthology.orchestra.run.smithi161.stdout:Building selftest 2023-08-10T10:33:20.532 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/selftest/group.list 2023-08-10T10:33:20.545 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo make install) 2023-08-10T10:33:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:Building include 2023-08-10T10:33:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:Building lib 2023-08-10T10:33:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:Building ltp 2023-08-10T10:33:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:Building src 2023-08-10T10:33:20.626 INFO:teuthology.orchestra.run.smithi161.stdout:Building log-writes 2023-08-10T10:33:20.630 INFO:teuthology.orchestra.run.smithi161.stdout:Building perf 2023-08-10T10:33:20.633 INFO:teuthology.orchestra.run.smithi161.stdout:Building aio-dio-regress 2023-08-10T10:33:20.637 INFO:teuthology.orchestra.run.smithi161.stdout:Building vfs 2023-08-10T10:33:20.640 INFO:teuthology.orchestra.run.smithi161.stdout:Building m4 2023-08-10T10:33:20.643 INFO:teuthology.orchestra.run.smithi161.stdout:Building common 2023-08-10T10:33:20.647 INFO:teuthology.orchestra.run.smithi161.stdout:Building tests 2023-08-10T10:33:20.652 INFO:teuthology.orchestra.run.smithi161.stdout:Building perf 2023-08-10T10:33:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/perf/group.list 2023-08-10T10:33:20.667 INFO:teuthology.orchestra.run.smithi161.stdout:Building ext4 2023-08-10T10:33:20.672 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ext4/group.list 2023-08-10T10:33:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:Building ocfs2 2023-08-10T10:33:20.710 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ocfs2/group.list 2023-08-10T10:33:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:Building overlay 2023-08-10T10:33:20.727 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/overlay/group.list 2023-08-10T10:33:20.762 INFO:teuthology.orchestra.run.smithi161.stdout:Building cifs 2023-08-10T10:33:20.767 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/cifs/group.list 2023-08-10T10:33:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:Building generic 2023-08-10T10:33:20.784 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/generic/group.list 2023-08-10T10:33:20.870 INFO:teuthology.orchestra.run.smithi161.stdout:Building shared 2023-08-10T10:33:20.875 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/shared/group.list 2023-08-10T10:33:20.889 INFO:teuthology.orchestra.run.smithi161.stdout:Building nfs 2023-08-10T10:33:20.894 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/nfs/group.list 2023-08-10T10:33:20.907 INFO:teuthology.orchestra.run.smithi161.stdout:Building f2fs 2023-08-10T10:33:20.911 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/f2fs/group.list 2023-08-10T10:33:20.926 INFO:teuthology.orchestra.run.smithi161.stdout:Building udf 2023-08-10T10:33:20.931 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/udf/group.list 2023-08-10T10:33:20.941 INFO:teuthology.orchestra.run.smithi161.stdout:Building ceph 2023-08-10T10:33:20.946 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/ceph/group.list 2023-08-10T10:33:20.959 INFO:teuthology.orchestra.run.smithi161.stdout:Building xfs 2023-08-10T10:33:20.965 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/xfs/group.list 2023-08-10T10:33:21.053 INFO:teuthology.orchestra.run.smithi161.stdout:Building btrfs 2023-08-10T10:33:21.058 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/btrfs/group.list 2023-08-10T10:33:21.110 INFO:teuthology.orchestra.run.smithi161.stdout:Building tmpfs 2023-08-10T10:33:21.115 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/tmpfs/group.list 2023-08-10T10:33:21.127 INFO:teuthology.orchestra.run.smithi161.stdout:Building selftest 2023-08-10T10:33:21.133 INFO:teuthology.orchestra.run.smithi161.stdout: [GROUP] /tmp/tmp.arJpumkS1bxfstests-dev/tests/selftest/group.list 2023-08-10T10:33:21.142 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi161.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi161.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-10T10:33:21.157 INFO:teuthology.orchestra.run.smithi161.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-10T10:33:21.234 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-10T10:33:21.242 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-10T10:33:21.258 INFO:teuthology.orchestra.run.smithi161.stdout:Building log-writes 2023-08-10T10:33:21.262 INFO:teuthology.orchestra.run.smithi161.stdout:Building perf 2023-08-10T10:33:21.265 INFO:teuthology.orchestra.run.smithi161.stdout:Building aio-dio-regress 2023-08-10T10:33:21.269 INFO:teuthology.orchestra.run.smithi161.stdout:Building vfs 2023-08-10T10:33:21.271 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake -C log-writes install 2023-08-10T10:33:21.273 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-10T10:33:21.282 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-10T10:33:21.290 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake -C perf install 2023-08-10T10:33:21.292 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-10T10:33:21.300 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-10T10:33:21.322 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-10T10:33:21.324 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-10T10:33:21.333 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-08-10T10:33:21.385 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake -C vfs install 2023-08-10T10:33:21.386 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-10T10:33:21.395 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-10T10:33:21.407 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-10T10:33:21.416 INFO:teuthology.orchestra.run.smithi161.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-10T10:33:22.604 INFO:teuthology.orchestra.run.smithi161.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-08-10T10:33:22.697 INFO:teuthology.orchestra.run.smithi161.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-10T10:33:22.728 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-10T10:33:22.729 INFO:teuthology.orchestra.run.smithi161.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-10T10:33:22.729 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-10T10:33:22.731 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-10T10:33:22.739 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-10T10:33:22.868 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-10T10:33:22.870 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/btrfs/ install 2023-08-10T10:33:22.872 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-10T10:33:22.881 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 299 /var/lib/xfstests/tests/btrfs 2023-08-10T10:33:23.688 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-10T10:33:23.697 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 024.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 196.out 242.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 003.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 184.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 004.out 211.out 158.out 182.out 146.out 188.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 175.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 007.out 293.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 021.out 253.out 255.out 090.out 221.out 087.out 294.out 212.out 112.out 256.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out /var/lib/xfstests/tests/btrfs 2023-08-10T10:33:24.503 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/ceph/ install 2023-08-10T10:33:24.505 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-10T10:33:24.514 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-10T10:33:24.533 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-10T10:33:24.541 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-08-10T10:33:24.561 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/cifs/ install 2023-08-10T10:33:24.563 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-10T10:33:24.571 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-10T10:33:24.580 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-10T10:33:24.588 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-10T10:33:24.597 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/ext4/ install 2023-08-10T10:33:24.599 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-10T10:33:24.607 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-10T10:33:24.795 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-10T10:33:24.804 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-08-10T10:33:25.002 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/f2fs/ install 2023-08-10T10:33:25.003 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-10T10:33:25.012 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-10T10:33:25.023 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-10T10:33:25.032 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-10T10:33:25.043 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/generic/ install 2023-08-10T10:33:25.047 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-10T10:33:25.056 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-08-10T10:33:27.022 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-10T10:33:27.030 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out 476.out /var/lib/xfstests/tests/generic 2023-08-10T10:33:29.027 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/nfs/ install 2023-08-10T10:33:29.028 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-10T10:33:29.037 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-10T10:33:29.045 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-10T10:33:29.054 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-10T10:33:29.063 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/ocfs2/ install 2023-08-10T10:33:29.064 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-10T10:33:29.073 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-10T10:33:29.081 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-10T10:33:29.090 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-10T10:33:29.099 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/overlay/ install 2023-08-10T10:33:29.100 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-10T10:33:29.109 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-10T10:33:29.378 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-10T10:33:29.387 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-08-10T10:33:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/perf/ install 2023-08-10T10:33:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-10T10:33:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-10T10:33:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-10T10:33:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/selftest/ install 2023-08-10T10:33:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-10T10:33:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-10T10:33:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-10T10:33:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-08-10T10:33:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/shared/ install 2023-08-10T10:33:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-10T10:33:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-10T10:33:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-10T10:33:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-08-10T10:33:29.801 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/tmpfs/ install 2023-08-10T10:33:29.803 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-10T10:33:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-10T10:33:29.819 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-10T10:33:29.828 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-10T10:33:29.837 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/udf/ install 2023-08-10T10:33:29.838 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-10T10:33:29.846 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-10T10:33:29.855 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-10T10:33:29.863 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-10T10:33:29.872 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.arJpumkS1bxfstests-dev/tests/xfs/ install 2023-08-10T10:33:29.876 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-10T10:33:29.885 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-10T10:33:31.757 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-10T10:33:31.766 INFO:teuthology.orchestra.run.smithi161.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-08-10T10:33:33.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:33.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:33.668 INFO:teuthology.orchestra.run.smithi161.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-10T10:33:33.677 INFO:teuthology.orchestra.run.smithi161.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-10T10:33:33.686 INFO:teuthology.orchestra.run.smithi161.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-10T10:33:33.694 INFO:teuthology.orchestra.run.smithi161.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-10T10:33:33.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:33.706 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec ls tests/generic) 2023-08-10T10:33:33.725 INFO:teuthology.orchestra.run.smithi161.stdout:001 2023-08-10T10:33:33.725 INFO:teuthology.orchestra.run.smithi161.stdout:001.out 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:002 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:002.out 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:003 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:003.out 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:004 2023-08-10T10:33:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:004.out 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:005 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:005.out 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:006 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:006.out 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:007 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:007.out 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:008 2023-08-10T10:33:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:008.out 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:009 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:009.out 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:010 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:010.out 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:011 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:011.out 2023-08-10T10:33:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:012 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:012.out 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:013 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:013.out 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:014 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:014.out 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:015 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:015.out 2023-08-10T10:33:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:016 2023-08-10T10:33:33.730 INFO:teuthology.orchestra.run.smithi161.stdout:016.out 2023-08-10T10:33:33.730 INFO:teuthology.orchestra.run.smithi161.stdout:017 2023-08-10T10:33:33.730 INFO:teuthology.orchestra.run.smithi161.stdout:017.out 2023-08-10T10:33:33.730 INFO:teuthology.orchestra.run.smithi161.stdout:018 2023-08-10T10:33:33.730 INFO:teuthology.orchestra.run.smithi161.stdout:018.out 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:019 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:019.out 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:020 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:020.out 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:021 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:021.out 2023-08-10T10:33:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:022 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:022.out 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:023 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:023.out 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:024 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:024.out 2023-08-10T10:33:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:025 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:025.out 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:026 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:026.out 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:027 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:027.out 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:028 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:028.out 2023-08-10T10:33:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:029 2023-08-10T10:33:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:029.out 2023-08-10T10:33:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:030 2023-08-10T10:33:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:030.out 2023-08-10T10:33:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:031 2023-08-10T10:33:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:031.out 2023-08-10T10:33:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:032 2023-08-10T10:33:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:032.out 2023-08-10T10:33:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:033 2023-08-10T10:33:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:033.out 2023-08-10T10:33:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:034 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:034.out 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:035 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:035.cfg 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:035.out.default 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:035.out.nfs 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:036 2023-08-10T10:33:33.736 INFO:teuthology.orchestra.run.smithi161.stdout:036.out 2023-08-10T10:33:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:037 2023-08-10T10:33:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:037.out 2023-08-10T10:33:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:038 2023-08-10T10:33:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:038.out 2023-08-10T10:33:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:039 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:039.out 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:040 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:040.out 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:041 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:041.out 2023-08-10T10:33:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:042 2023-08-10T10:33:33.739 INFO:teuthology.orchestra.run.smithi161.stdout:042.out 2023-08-10T10:33:33.739 INFO:teuthology.orchestra.run.smithi161.stdout:043 2023-08-10T10:33:33.739 INFO:teuthology.orchestra.run.smithi161.stdout:043.out 2023-08-10T10:33:33.739 INFO:teuthology.orchestra.run.smithi161.stdout:044 2023-08-10T10:33:33.740 INFO:teuthology.orchestra.run.smithi161.stdout:044.out 2023-08-10T10:33:33.740 INFO:teuthology.orchestra.run.smithi161.stdout:045 2023-08-10T10:33:33.740 INFO:teuthology.orchestra.run.smithi161.stdout:045.out 2023-08-10T10:33:33.741 INFO:teuthology.orchestra.run.smithi161.stdout:046 2023-08-10T10:33:33.741 INFO:teuthology.orchestra.run.smithi161.stdout:046.out 2023-08-10T10:33:33.741 INFO:teuthology.orchestra.run.smithi161.stdout:047 2023-08-10T10:33:33.741 INFO:teuthology.orchestra.run.smithi161.stdout:047.out 2023-08-10T10:33:33.742 INFO:teuthology.orchestra.run.smithi161.stdout:048 2023-08-10T10:33:33.742 INFO:teuthology.orchestra.run.smithi161.stdout:048.out 2023-08-10T10:33:33.742 INFO:teuthology.orchestra.run.smithi161.stdout:049 2023-08-10T10:33:33.743 INFO:teuthology.orchestra.run.smithi161.stdout:049.out 2023-08-10T10:33:33.743 INFO:teuthology.orchestra.run.smithi161.stdout:050 2023-08-10T10:33:33.743 INFO:teuthology.orchestra.run.smithi161.stdout:050.cfg 2023-08-10T10:33:33.743 INFO:teuthology.orchestra.run.smithi161.stdout:050.out.default 2023-08-10T10:33:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:050.out.nojournal 2023-08-10T10:33:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:050.out.xfsquota 2023-08-10T10:33:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:051 2023-08-10T10:33:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:051.out 2023-08-10T10:33:33.745 INFO:teuthology.orchestra.run.smithi161.stdout:052 2023-08-10T10:33:33.745 INFO:teuthology.orchestra.run.smithi161.stdout:052.out 2023-08-10T10:33:33.745 INFO:teuthology.orchestra.run.smithi161.stdout:053 2023-08-10T10:33:33.745 INFO:teuthology.orchestra.run.smithi161.stdout:053.out 2023-08-10T10:33:33.746 INFO:teuthology.orchestra.run.smithi161.stdout:054 2023-08-10T10:33:33.746 INFO:teuthology.orchestra.run.smithi161.stdout:054.out 2023-08-10T10:33:33.746 INFO:teuthology.orchestra.run.smithi161.stdout:055 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:055.out 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:056 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:056.out 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:057 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:057.out 2023-08-10T10:33:33.747 INFO:teuthology.orchestra.run.smithi161.stdout:058 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:058.out 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:059 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:059.out 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:060 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:060.out 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:061 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:061.out 2023-08-10T10:33:33.748 INFO:teuthology.orchestra.run.smithi161.stdout:062 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:062.out 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:063 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:063.out 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:064 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:064.out 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:065 2023-08-10T10:33:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:065.out 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:066 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:066.out 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:067 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:067.out 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:068 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:068.out 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:069 2023-08-10T10:33:33.750 INFO:teuthology.orchestra.run.smithi161.stdout:069.out 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:070 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:070.out 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:071 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:071.out 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:072 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:072.out 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:073 2023-08-10T10:33:33.751 INFO:teuthology.orchestra.run.smithi161.stdout:073.out 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:074 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:074.out 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:075 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:075.out 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:076 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:076.out 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:077 2023-08-10T10:33:33.752 INFO:teuthology.orchestra.run.smithi161.stdout:077.out 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:078 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:078.out 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:079 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:079.out 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:080 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:080.out 2023-08-10T10:33:33.753 INFO:teuthology.orchestra.run.smithi161.stdout:081 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:081.out 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:082 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:082.out 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:083 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:083.out 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:084 2023-08-10T10:33:33.754 INFO:teuthology.orchestra.run.smithi161.stdout:084.out 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:085 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:085.out 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:086 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:086.out 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:087 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:087.out 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:088 2023-08-10T10:33:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:088.out 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:089 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:089.out 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:090 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:090.out 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:091 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:091.out 2023-08-10T10:33:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:092 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:092.out 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:093 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:093.out 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:094 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:094.out 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:095 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:095.out 2023-08-10T10:33:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:096 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:096.out 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:097 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:097.out 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:098 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:098.out 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:099 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:099.out 2023-08-10T10:33:33.758 INFO:teuthology.orchestra.run.smithi161.stdout:100 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:100.out 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:101 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:101.out 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:102 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:102.out 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:103 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:103.out 2023-08-10T10:33:33.759 INFO:teuthology.orchestra.run.smithi161.stdout:104 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:104.out 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:105 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:105.out 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:106 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:106.out 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:107 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:107.out 2023-08-10T10:33:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:108 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:108.out 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:109 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:109.out 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:110 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:110.out 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:111 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:111.out 2023-08-10T10:33:33.761 INFO:teuthology.orchestra.run.smithi161.stdout:112 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:112.out 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:113 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:113.out 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:114 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:114.out 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:115 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:115.out 2023-08-10T10:33:33.762 INFO:teuthology.orchestra.run.smithi161.stdout:116 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:116.out 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:117 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:117.out 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:118 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:118.out 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:119 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:119.out 2023-08-10T10:33:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:120 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:120.out 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:121 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:121.out 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:122 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:122.out 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:123 2023-08-10T10:33:33.764 INFO:teuthology.orchestra.run.smithi161.stdout:123.out 2023-08-10T10:33:33.765 INFO:teuthology.orchestra.run.smithi161.stdout:124 2023-08-10T10:33:33.765 INFO:teuthology.orchestra.run.smithi161.stdout:124.out 2023-08-10T10:33:33.765 INFO:teuthology.orchestra.run.smithi161.stdout:125 2023-08-10T10:33:33.765 INFO:teuthology.orchestra.run.smithi161.stdout:125.out 2023-08-10T10:33:33.765 INFO:teuthology.orchestra.run.smithi161.stdout:126 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:126.out 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:127 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:127.out 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:128 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:128.out 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:129 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:129.out 2023-08-10T10:33:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:130 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:130.out 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:131 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:131.out 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:132 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:132.out 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:133 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:133.out 2023-08-10T10:33:33.767 INFO:teuthology.orchestra.run.smithi161.stdout:134 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:134.out 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:135 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:135.out 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:136 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:136.out 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:137 2023-08-10T10:33:33.768 INFO:teuthology.orchestra.run.smithi161.stdout:137.out 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:138 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:138.out 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:139 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:139.out 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:140 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:140.out 2023-08-10T10:33:33.769 INFO:teuthology.orchestra.run.smithi161.stdout:141 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:141.out 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:142 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:142.out 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:143 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:143.out 2023-08-10T10:33:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:144 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:144.out 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:145 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:145.out 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:146 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:146.out 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:147 2023-08-10T10:33:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:147.out 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:148 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:148.out 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:149 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:149.out 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:150 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:150.out 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:151 2023-08-10T10:33:33.772 INFO:teuthology.orchestra.run.smithi161.stdout:151.out 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:152 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:152.out 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:153 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:153.out 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:154 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:154.out 2023-08-10T10:33:33.773 INFO:teuthology.orchestra.run.smithi161.stdout:155 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:155.out 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:156 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:156.out 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:157 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:157.out 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:158 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:158.out 2023-08-10T10:33:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:159 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:159.out 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:160 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:160.out 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:161 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:161.out 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:162 2023-08-10T10:33:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:162.out 2023-08-10T10:33:33.776 INFO:teuthology.orchestra.run.smithi161.stdout:163 2023-08-10T10:33:33.776 INFO:teuthology.orchestra.run.smithi161.stdout:163.out 2023-08-10T10:33:33.776 INFO:teuthology.orchestra.run.smithi161.stdout:164 2023-08-10T10:33:33.776 INFO:teuthology.orchestra.run.smithi161.stdout:164.out 2023-08-10T10:33:33.776 INFO:teuthology.orchestra.run.smithi161.stdout:165 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:165.out 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:166 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:166.out 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:167 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:167.out 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:168 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:168.out 2023-08-10T10:33:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:169 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:169.out 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:170 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:170.out 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:171 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:171.out 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:172 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:172.out 2023-08-10T10:33:33.778 INFO:teuthology.orchestra.run.smithi161.stdout:173 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:173.out 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:174 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:174.out 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:175 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:175.out 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:176 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:176.out 2023-08-10T10:33:33.779 INFO:teuthology.orchestra.run.smithi161.stdout:177 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:177.out 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:178 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:178.out 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:179 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:179.out 2023-08-10T10:33:33.780 INFO:teuthology.orchestra.run.smithi161.stdout:180 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:180.out 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:181 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:181.out 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:182 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:182.out 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:183 2023-08-10T10:33:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:183.out 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:184 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:184.out 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:185 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:185.out 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:186 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:186.out 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:187 2023-08-10T10:33:33.782 INFO:teuthology.orchestra.run.smithi161.stdout:187.out 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:188 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:188.out 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:189 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:189.out 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:190 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:190.out 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:191 2023-08-10T10:33:33.783 INFO:teuthology.orchestra.run.smithi161.stdout:191.out 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:192 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:192.out 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:193 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:193.out 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:194 2023-08-10T10:33:33.784 INFO:teuthology.orchestra.run.smithi161.stdout:194.out 2023-08-10T10:33:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:195 2023-08-10T10:33:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:195.out 2023-08-10T10:33:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:196 2023-08-10T10:33:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:196.out 2023-08-10T10:33:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:197 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:197.out 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:198 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:198.out 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:199 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:199.out 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:200 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:200.out 2023-08-10T10:33:33.786 INFO:teuthology.orchestra.run.smithi161.stdout:201 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:201.out 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:202 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:202.out 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:203 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:203.out 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:204 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:204.out 2023-08-10T10:33:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:205 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:205.out 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:206 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:206.out 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:207 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:207.out 2023-08-10T10:33:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:208 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:208.out 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:209 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:209.out 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:210 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:210.out 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:211 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:211.out 2023-08-10T10:33:33.789 INFO:teuthology.orchestra.run.smithi161.stdout:212 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:212.out 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:213 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:213.out 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:214 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:214.out 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:215 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:215.out 2023-08-10T10:33:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:216 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:216.out 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:217 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:217.out 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:218 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:218.out 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:219 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:219.out 2023-08-10T10:33:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:220 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:220.out 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:221 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:221.out 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:222 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:222.out 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:223 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:223.out 2023-08-10T10:33:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:224 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:224.out 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:225 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:225.out 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:226 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:226.out 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:227 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:227.out 2023-08-10T10:33:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:228 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:228.out 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:229 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:229.out 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:230 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:230.out 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:231 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:231.out 2023-08-10T10:33:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:232 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:232.out 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:233 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:233.out 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:234 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:234.out 2023-08-10T10:33:33.795 INFO:teuthology.orchestra.run.smithi161.stdout:235 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:235.out 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:236 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:236.out 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:237 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:237.out 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:238 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:238.out 2023-08-10T10:33:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:239 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:239.out 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:240 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:240.out 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:241 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:241.out 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:242 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:242.out 2023-08-10T10:33:33.797 INFO:teuthology.orchestra.run.smithi161.stdout:243 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:243.out 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:244 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:244.out 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:245 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:245.out 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:246 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:246.out 2023-08-10T10:33:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:247 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:247.out 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:248 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:248.out 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:249 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:249.out 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:250 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:250.out 2023-08-10T10:33:33.799 INFO:teuthology.orchestra.run.smithi161.stdout:251 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:251.out 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:252 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:252.out 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:253 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:253.out 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:254 2023-08-10T10:33:33.800 INFO:teuthology.orchestra.run.smithi161.stdout:254.out 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:255 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:255.out 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:256 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:256.out 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:257 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:257.out 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:258 2023-08-10T10:33:33.801 INFO:teuthology.orchestra.run.smithi161.stdout:258.out 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:259 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:259.out 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:260 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:260.out 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:261 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:261.out 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:262 2023-08-10T10:33:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:262.out 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:263 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:263.out 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:264 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:264.out 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:265 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:265.out 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:266 2023-08-10T10:33:33.803 INFO:teuthology.orchestra.run.smithi161.stdout:266.out 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:267 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:267.out 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:268 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:268.out 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:269 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:269.out 2023-08-10T10:33:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:270 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:270.out 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:271 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:271.out 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:272 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:272.out 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:273 2023-08-10T10:33:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:273.out 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:274 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:274.out 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:275 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:275.out 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:276 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:276.out 2023-08-10T10:33:33.806 INFO:teuthology.orchestra.run.smithi161.stdout:277 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:277.out 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:278 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:278.out 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:279 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:279.out 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:280 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:280.out 2023-08-10T10:33:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:281 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:281.out 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:282 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:282.out 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:283 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:283.out 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:284 2023-08-10T10:33:33.808 INFO:teuthology.orchestra.run.smithi161.stdout:284.out 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:285 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:285.out 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:286 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:286.out 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:287 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:287.out 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:288 2023-08-10T10:33:33.809 INFO:teuthology.orchestra.run.smithi161.stdout:288.out 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:289 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:289.out 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:290 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:290.out 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:291 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:291.out 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:292 2023-08-10T10:33:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:292.out 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:293 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:293.out 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:294 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:294.out 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:295 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:295.out 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:296 2023-08-10T10:33:33.811 INFO:teuthology.orchestra.run.smithi161.stdout:296.out 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:297 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:297.out 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:298 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:298.out 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:299 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:299.out 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:300 2023-08-10T10:33:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:300.out 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:301 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:301.out 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:302 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:302.out 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:303 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:303.out 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:304 2023-08-10T10:33:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:304.out 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:305 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:305.out 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:306 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:306.out 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:307 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:307.out 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:308 2023-08-10T10:33:33.814 INFO:teuthology.orchestra.run.smithi161.stdout:308.out 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:309 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:309.out 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:310 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:310.out 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:311 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:311.out 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:312 2023-08-10T10:33:33.815 INFO:teuthology.orchestra.run.smithi161.stdout:312.out 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:313 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:313.out 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:314 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:314.out 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:315 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:315.out 2023-08-10T10:33:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:316 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:316.out 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:317 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:317.out 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:318 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:318.out 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:319 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:319.out 2023-08-10T10:33:33.817 INFO:teuthology.orchestra.run.smithi161.stdout:320 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:320.out 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:321 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:321.out 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:322 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:322.out 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:323 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:323.out 2023-08-10T10:33:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:324 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:324.out 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:325 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:325.out 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:326 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:326.out 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:327 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:327.out 2023-08-10T10:33:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:328 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:328.out 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:329 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:329.out 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:330 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:330.out 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:331 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:331.out 2023-08-10T10:33:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:332 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:332.out 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:333 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:333.out 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:334 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:334.out 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:335 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:335.out 2023-08-10T10:33:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:336 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:336.out 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:337 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:337.out 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:338 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:338.out 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:339 2023-08-10T10:33:33.822 INFO:teuthology.orchestra.run.smithi161.stdout:339.out 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:340 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:340.out 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:341 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:341.out 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:342 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:342.out 2023-08-10T10:33:33.823 INFO:teuthology.orchestra.run.smithi161.stdout:343 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:343.out 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:344 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:344.out 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:345 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:345.out 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:346 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:346.out 2023-08-10T10:33:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:347 2023-08-10T10:33:33.825 INFO:teuthology.orchestra.run.smithi161.stdout:347.out 2023-08-10T10:33:33.825 INFO:teuthology.orchestra.run.smithi161.stdout:348 2023-08-10T10:33:33.825 INFO:teuthology.orchestra.run.smithi161.stdout:348.out 2023-08-10T10:33:33.825 INFO:teuthology.orchestra.run.smithi161.stdout:349 2023-08-10T10:33:33.825 INFO:teuthology.orchestra.run.smithi161.stdout:349.out 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:350 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:350.out 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:351 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:351.out 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:352 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:352.out 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:353 2023-08-10T10:33:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:353.out 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:354 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:354.out 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:355 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:355.out 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:356 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:356.out 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:357 2023-08-10T10:33:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:357.out 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:358 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:358.out 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:359 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:359.out 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:360 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:360.out 2023-08-10T10:33:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:361 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:361.out 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:362 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:362.out 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:363 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:363.out 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:364 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:364.out 2023-08-10T10:33:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:365 2023-08-10T10:33:33.830 INFO:teuthology.orchestra.run.smithi161.stdout:365.out 2023-08-10T10:33:33.830 INFO:teuthology.orchestra.run.smithi161.stdout:366 2023-08-10T10:33:33.830 INFO:teuthology.orchestra.run.smithi161.stdout:366.out 2023-08-10T10:33:33.830 INFO:teuthology.orchestra.run.smithi161.stdout:367 2023-08-10T10:33:33.830 INFO:teuthology.orchestra.run.smithi161.stdout:367.out 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:368 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:368.out 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:369 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:369.out 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:370 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:370.out 2023-08-10T10:33:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:371 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:371.out 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:372 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:372.out 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:373 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:373.out 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:374 2023-08-10T10:33:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:374.out 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:375 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:375.out 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:376 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:376.out 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:377 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:377.out 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:378 2023-08-10T10:33:33.833 INFO:teuthology.orchestra.run.smithi161.stdout:378.out 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:379 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:379.out 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:380 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:380.out 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:381 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:381.out 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:382 2023-08-10T10:33:33.834 INFO:teuthology.orchestra.run.smithi161.stdout:382.out 2023-08-10T10:33:33.835 INFO:teuthology.orchestra.run.smithi161.stdout:383 2023-08-10T10:33:33.835 INFO:teuthology.orchestra.run.smithi161.stdout:383.out 2023-08-10T10:33:33.835 INFO:teuthology.orchestra.run.smithi161.stdout:384 2023-08-10T10:33:33.835 INFO:teuthology.orchestra.run.smithi161.stdout:384.out 2023-08-10T10:33:33.835 INFO:teuthology.orchestra.run.smithi161.stdout:385 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:385.out 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:386 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:386.out 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:387 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:387.out 2023-08-10T10:33:33.836 INFO:teuthology.orchestra.run.smithi161.stdout:388 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:388.out 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:389 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:389.out 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:390 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:390.out 2023-08-10T10:33:33.837 INFO:teuthology.orchestra.run.smithi161.stdout:391 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:391.out 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:392 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:392.out 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:393 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:393.out 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:394 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:394.out 2023-08-10T10:33:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:395 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:395.out 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:396 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:396.out 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:397 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:397.out 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:398 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:398.out 2023-08-10T10:33:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:399 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:399.out 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:400 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:400.out 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:401 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:401.out 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:402 2023-08-10T10:33:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:402.out 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:403 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:403.out 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:404 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:404.out 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:405 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:405.out 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:406 2023-08-10T10:33:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:406.out 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:407 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:407.out 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:408 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:408.out 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:409 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:409.out 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:410 2023-08-10T10:33:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:410.out 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:411 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:411.out 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:412 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:412.out 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:413 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:413.out 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:414 2023-08-10T10:33:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:414.out 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:415 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:415.out 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:416 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:416.out 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:417 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:417.out 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:418 2023-08-10T10:33:33.844 INFO:teuthology.orchestra.run.smithi161.stdout:418.out 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:419 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:419.out 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:420 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:420.out 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:421 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:421.out 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:422 2023-08-10T10:33:33.845 INFO:teuthology.orchestra.run.smithi161.stdout:422.out 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:423 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:423.out 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:424 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:424.out 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:425 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:425.out 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:426 2023-08-10T10:33:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:426.out 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:427 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:427.out 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:428 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:428.out 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:429 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:429.out 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:430 2023-08-10T10:33:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:430.out 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:431 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:431.out 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:432 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:432.out 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:433 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:433.out 2023-08-10T10:33:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:434 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:434.out 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:435 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:435.out 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:436 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:436.out 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:437 2023-08-10T10:33:33.849 INFO:teuthology.orchestra.run.smithi161.stdout:437.out 2023-08-10T10:33:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:438 2023-08-10T10:33:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:438.out 2023-08-10T10:33:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:439 2023-08-10T10:33:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:439.out 2023-08-10T10:33:33.851 INFO:teuthology.orchestra.run.smithi161.stdout:440 2023-08-10T10:33:33.851 INFO:teuthology.orchestra.run.smithi161.stdout:440.out 2023-08-10T10:33:33.851 INFO:teuthology.orchestra.run.smithi161.stdout:441 2023-08-10T10:33:33.852 INFO:teuthology.orchestra.run.smithi161.stdout:441.out 2023-08-10T10:33:33.852 INFO:teuthology.orchestra.run.smithi161.stdout:442 2023-08-10T10:33:33.852 INFO:teuthology.orchestra.run.smithi161.stdout:442.out 2023-08-10T10:33:33.852 INFO:teuthology.orchestra.run.smithi161.stdout:443 2023-08-10T10:33:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:443.out 2023-08-10T10:33:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:444 2023-08-10T10:33:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:444.out 2023-08-10T10:33:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:445 2023-08-10T10:33:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:445.out 2023-08-10T10:33:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:446 2023-08-10T10:33:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:446.out 2023-08-10T10:33:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:447 2023-08-10T10:33:33.855 INFO:teuthology.orchestra.run.smithi161.stdout:447.out 2023-08-10T10:33:33.855 INFO:teuthology.orchestra.run.smithi161.stdout:448 2023-08-10T10:33:33.855 INFO:teuthology.orchestra.run.smithi161.stdout:448.out 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:449 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:449.out 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:450 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:450.out 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:451 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:451.out 2023-08-10T10:33:33.856 INFO:teuthology.orchestra.run.smithi161.stdout:452 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:452.out 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:453 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:453.out 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:454 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:454.out 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:455 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:455.out 2023-08-10T10:33:33.857 INFO:teuthology.orchestra.run.smithi161.stdout:456 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:456.out 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:457 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:457.out 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:458 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:458.out 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:459 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:459.out 2023-08-10T10:33:33.858 INFO:teuthology.orchestra.run.smithi161.stdout:460 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:460.out 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:461 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:461.out 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:462 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:462.out 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:463 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:463.out 2023-08-10T10:33:33.859 INFO:teuthology.orchestra.run.smithi161.stdout:464 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:464.out 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:465 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:465.out 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:466 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:466.out 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:467 2023-08-10T10:33:33.860 INFO:teuthology.orchestra.run.smithi161.stdout:467.out 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:468 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:468.out 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:469 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:469.out 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:470 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:470.out 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:471 2023-08-10T10:33:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:471.out 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:472 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:472.out 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:473 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:473.out 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:474 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:474.out 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:475 2023-08-10T10:33:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:475.out 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:476 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:476.out 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:477 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:477.out 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:478 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:478.out 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:479 2023-08-10T10:33:33.863 INFO:teuthology.orchestra.run.smithi161.stdout:479.out 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:480 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:480.out 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:481 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:481.out 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:482 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:482.out 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:483 2023-08-10T10:33:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:483.out 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:484 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:484.out 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:485 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:485.out 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:486 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:486.out 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:487 2023-08-10T10:33:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:487.out 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:488 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:488.out 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:489 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:489.out 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:490 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:490.out 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:491 2023-08-10T10:33:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:491.out 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:492 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:492.out 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:493 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:493.out 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:494 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:494.out 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:495 2023-08-10T10:33:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:495.out 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:496 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:496.out 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:497 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:497.out 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:498 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:498.out 2023-08-10T10:33:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:499 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:499.out 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:500 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:500.out 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:501 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:501.out 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:502 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:502.out 2023-08-10T10:33:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:503 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:503.out 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:504 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:504.out 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:505 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:505.out 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:506 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:506.out 2023-08-10T10:33:33.870 INFO:teuthology.orchestra.run.smithi161.stdout:507 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:507.out 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:508 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:508.out 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:509 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:509.out 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:510 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:510.out 2023-08-10T10:33:33.871 INFO:teuthology.orchestra.run.smithi161.stdout:511 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:511.out 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:512 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:512.out 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:513 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:513.out 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:514 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:514.out 2023-08-10T10:33:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:515 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:515.out 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:516 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:516.out 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:517 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:517.out 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:518 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:518.out 2023-08-10T10:33:33.873 INFO:teuthology.orchestra.run.smithi161.stdout:519 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:519.out 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:520 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:520.out 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:521 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:521.out 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:522 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:522.out 2023-08-10T10:33:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:523 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:523.out 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:524 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:524.out 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:525 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:525.out 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:526 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:526.out 2023-08-10T10:33:33.875 INFO:teuthology.orchestra.run.smithi161.stdout:527 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:527.out 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:528 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:528.out 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:529 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:529.out 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:530 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:530.out 2023-08-10T10:33:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:531 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:531.out 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:532 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:532.out 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:533 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:533.out 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:534 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:534.out 2023-08-10T10:33:33.877 INFO:teuthology.orchestra.run.smithi161.stdout:535 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:535.out 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:536 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:536.out 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:537 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:537.out 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:538 2023-08-10T10:33:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:538.out 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:539 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:539.out 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:540 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:540.out 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:541 2023-08-10T10:33:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:541.out 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:542 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:542.out 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:543 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:543.out 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:544 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:544.out 2023-08-10T10:33:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:545 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:545.out 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:546 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:546.out 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:547 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:547.out 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:548 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:548.out 2023-08-10T10:33:33.881 INFO:teuthology.orchestra.run.smithi161.stdout:549 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:549.out 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:550 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:550.out 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:551 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:551.out 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:552 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:552.out 2023-08-10T10:33:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:553 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:553.out 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:554 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:554.out 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:555 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:555.out 2023-08-10T10:33:33.883 INFO:teuthology.orchestra.run.smithi161.stdout:556 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:556.out 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:557 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:557.out 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:558 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:558.out 2023-08-10T10:33:33.884 INFO:teuthology.orchestra.run.smithi161.stdout:559 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:559.out 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:560 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:560.out 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:561 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:561.out 2023-08-10T10:33:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:562 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:562.out 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:563 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:563.out 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:564 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:564.out 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:565 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:565.out 2023-08-10T10:33:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:566 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:566.out 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:567 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:567.out 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:568 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:568.out 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:569 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:569.out 2023-08-10T10:33:33.887 INFO:teuthology.orchestra.run.smithi161.stdout:570 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:570.out 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:571 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:571.out 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:572 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:572.out 2023-08-10T10:33:33.888 INFO:teuthology.orchestra.run.smithi161.stdout:573 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:573.out 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:574 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:574.out 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:575 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:575.out 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:576 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:576.out 2023-08-10T10:33:33.889 INFO:teuthology.orchestra.run.smithi161.stdout:577 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:577.out 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:578 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:578.out 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:579 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:579.out 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:580 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:580.out 2023-08-10T10:33:33.890 INFO:teuthology.orchestra.run.smithi161.stdout:581 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:581.out 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:582 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:582.out 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:583 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:583.out 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:584 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:584.out 2023-08-10T10:33:33.891 INFO:teuthology.orchestra.run.smithi161.stdout:585 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:585.out 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:586 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:586.out 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:587 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:587.out 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:588 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:588.out 2023-08-10T10:33:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:589 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:589.out 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:590 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:590.out 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:591 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:591.out 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:592 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:592.out 2023-08-10T10:33:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:593 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:593.out 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:594 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:594.out 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:595 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:595.out 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:596 2023-08-10T10:33:33.894 INFO:teuthology.orchestra.run.smithi161.stdout:596.out 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:597 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:597.out 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:598 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:598.out 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:599 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:599.out 2023-08-10T10:33:33.895 INFO:teuthology.orchestra.run.smithi161.stdout:600 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:600.out 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:601 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:601.out 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:602 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:602.out 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:603 2023-08-10T10:33:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:603.out 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:604 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:604.out 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:605 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:605.out 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:606 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:606.out 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:607 2023-08-10T10:33:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:607.out 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:608 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:608.out 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:609 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:609.out 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:610 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:610.out 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:611 2023-08-10T10:33:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:611.out 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:612 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:612.out 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:613 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:613.out 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:614 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:614.out 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:615 2023-08-10T10:33:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:615.out 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:616 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:616.out 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:617 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:617.out 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:618 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:618.out 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:619 2023-08-10T10:33:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:619.out 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:620 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:620.out 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:621 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:621.out 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:622 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:622.out 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:623 2023-08-10T10:33:33.901 INFO:teuthology.orchestra.run.smithi161.stdout:623.out 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:624 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:624.out 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:625 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:625.out 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:626 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:626.out 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:627 2023-08-10T10:33:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:627.out 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:628 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:628.out 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:629 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:629.out 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:630 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:630.out 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:631 2023-08-10T10:33:33.903 INFO:teuthology.orchestra.run.smithi161.stdout:631.out 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:632 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:632.out 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:633 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:633.out 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:634 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:634.out 2023-08-10T10:33:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:635 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:635.out 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:636 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:636.out 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:637 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:637.out 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:638 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:638.out 2023-08-10T10:33:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:639 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:639.out 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:640 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:640.out 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:641 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:641.out 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:642 2023-08-10T10:33:33.906 INFO:teuthology.orchestra.run.smithi161.stdout:642.out 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:643 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:643.out 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:644 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:644.out 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:645 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:645.out 2023-08-10T10:33:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:646 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:646.out 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:647 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:647.out 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:648 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:648.out 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:649 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:649.out 2023-08-10T10:33:33.908 INFO:teuthology.orchestra.run.smithi161.stdout:650 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:650.out 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:651 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:651.out 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:652 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:652.out 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:653 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:653.out 2023-08-10T10:33:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:654 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:654.out 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:655 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:655.out 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:656 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:656.out 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:657 2023-08-10T10:33:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:657.out 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:658 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:658.out 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:659 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:659.out 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:660 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:660.out 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:661 2023-08-10T10:33:33.911 INFO:teuthology.orchestra.run.smithi161.stdout:661.out 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:662 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:662.out 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:663 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:663.out 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:664 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:664.out 2023-08-10T10:33:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:665 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:665.out 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:666 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:666.out 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:667 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:667.out 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:668 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:668.out 2023-08-10T10:33:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:669 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:669.out 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:670 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:670.out 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:671 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:671.out 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:672 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:672.out 2023-08-10T10:33:33.914 INFO:teuthology.orchestra.run.smithi161.stdout:673 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:673.out 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:674 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:674.out 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:675 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:675.out 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:676 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:676.out 2023-08-10T10:33:33.915 INFO:teuthology.orchestra.run.smithi161.stdout:677 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:677.out 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:678 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:678.out 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:679 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:679.out 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:680 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:680.out 2023-08-10T10:33:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:681 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:681.out 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:682 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:682.out 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:683 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:683.out 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:684 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:684.out 2023-08-10T10:33:33.917 INFO:teuthology.orchestra.run.smithi161.stdout:685 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:685.out 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:686 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:686.out 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:687 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:687.out 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:688 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:688.out 2023-08-10T10:33:33.918 INFO:teuthology.orchestra.run.smithi161.stdout:689 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:689.out 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:690 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:690.out 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:691 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:691.out 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:692 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:692.out 2023-08-10T10:33:33.919 INFO:teuthology.orchestra.run.smithi161.stdout:693 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:693.out 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:694 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:694.out 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:695 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:695.out 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:696 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:696.out 2023-08-10T10:33:33.920 INFO:teuthology.orchestra.run.smithi161.stdout:697 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:697.out 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:698 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:698.out 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:699 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:699.out 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:700 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:700.out 2023-08-10T10:33:33.921 INFO:teuthology.orchestra.run.smithi161.stdout:701 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:701.out 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:702 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:702.out 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:703 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:703.out 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:704 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:704.out 2023-08-10T10:33:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:705 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:705.out 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:706 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:706.out 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:707 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:707.out 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:708 2023-08-10T10:33:33.923 INFO:teuthology.orchestra.run.smithi161.stdout:708.out 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:709 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:709.out 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:710 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:710.out 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:711 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:711.out 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:712 2023-08-10T10:33:33.924 INFO:teuthology.orchestra.run.smithi161.stdout:712.out 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:713 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:713.out 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:714 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:714.out 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:715 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:715.out 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:716 2023-08-10T10:33:33.925 INFO:teuthology.orchestra.run.smithi161.stdout:716.out 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:717 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:717.out 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:718 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:718.out 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:719 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:719.out 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:720 2023-08-10T10:33:33.926 INFO:teuthology.orchestra.run.smithi161.stdout:720.out 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:721 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:721.out 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:722 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:722.out 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:723 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:723.out 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:724 2023-08-10T10:33:33.927 INFO:teuthology.orchestra.run.smithi161.stdout:724.out 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:725 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:725.out 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:726 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:726.out 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:727 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:727.out 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:728 2023-08-10T10:33:33.928 INFO:teuthology.orchestra.run.smithi161.stdout:728.out 2023-08-10T10:33:33.929 INFO:teuthology.orchestra.run.smithi161.stdout:729 2023-08-10T10:33:33.929 INFO:teuthology.orchestra.run.smithi161.stdout:729.out 2023-08-10T10:33:33.929 INFO:teuthology.orchestra.run.smithi161.stdout:group.list 2023-08-10T10:33:33.929 INFO:teuthology.orchestra.run.smithi161.stdout:Makefile 2023-08-10T10:33:33.929 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-08-10T10:33:34.147 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:34.151 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:34.152 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:34.153 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:34.153 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:39.032 INFO:teuthology.orchestra.run.smithi161.stdout:generic/001 5s 2023-08-10T10:33:39.036 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/001 2023-08-10T10:33:39.037 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:33:39.038 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:39.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:33:39.774 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-08-10T10:33:39.968 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:39.972 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:39.973 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:39.973 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:39.974 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:40.557 INFO:teuthology.orchestra.run.smithi161.stdout:generic/002 0s 2023-08-10T10:33:40.562 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/002 2023-08-10T10:33:40.563 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:33:40.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:40.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:33:40.630 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-08-10T10:33:40.832 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:40.836 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:40.836 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:40.837 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:40.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:41.150 INFO:teuthology.orchestra.run.smithi161.stdout:generic/003 [not run] atime not maintained by ceph 2023-08-10T10:33:41.154 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/003 2023-08-10T10:33:41.154 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/003 2023-08-10T10:33:41.154 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:33:41.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:41.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:33:41.178 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-08-10T10:33:41.376 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:41.380 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:41.381 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:41.382 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:41.382 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:41.697 INFO:teuthology.orchestra.run.smithi161.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-10T10:33:41.701 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/004 2023-08-10T10:33:41.701 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/004 2023-08-10T10:33:41.701 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:33:41.703 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:41.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:33:41.734 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-08-10T10:33:41.951 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:41.955 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:41.955 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:41.956 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:41.956 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:42.449 INFO:teuthology.orchestra.run.smithi161.stdout:generic/005 0s 2023-08-10T10:33:42.454 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/005 2023-08-10T10:33:42.454 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:33:42.456 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:33:42.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:33:42.546 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-08-10T10:33:42.754 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:33:42.759 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:33:42.759 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:33:42.760 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:33:42.760 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:03.661 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:03.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:07.498 INFO:teuthology.orchestra.run.smithi161.stdout:generic/006 25s 2023-08-10T10:34:07.502 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/006 2023-08-10T10:34:07.503 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:34:07.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:07.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:34:07.559 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-08-10T10:34:08.010 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:34:08.014 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:34:08.015 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:34:08.016 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:34:08.016 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:33.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:33.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:57.832 INFO:teuthology.orchestra.run.smithi161.stdout:generic/007 49s 2023-08-10T10:34:57.836 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/007 2023-08-10T10:34:57.837 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:34:57.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:57.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:34:57.905 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-08-10T10:34:58.110 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:34:58.114 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:34:58.115 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:34:58.115 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:34:58.116 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:58.528 INFO:teuthology.orchestra.run.smithi161.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-10T10:34:58.532 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/008 2023-08-10T10:34:58.532 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/008 2023-08-10T10:34:58.532 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:34:58.534 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:58.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:34:58.558 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-08-10T10:34:58.760 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:34:58.764 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:34:58.765 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:34:58.765 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:34:58.765 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:59.135 INFO:teuthology.orchestra.run.smithi161.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-10T10:34:59.139 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/009 2023-08-10T10:34:59.139 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/009 2023-08-10T10:34:59.140 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:34:59.141 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:59.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:34:59.166 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-08-10T10:34:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:34:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:34:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:34:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:34:59.389 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:59.700 INFO:teuthology.orchestra.run.smithi161.stdout:generic/010 [not run] /tmp/tmp.arJpumkS1bxfstests-dev/src/dbtest not built 2023-08-10T10:34:59.704 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/010 2023-08-10T10:34:59.704 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/010 2023-08-10T10:34:59.704 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:34:59.706 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:34:59.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:34:59.733 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-08-10T10:34:59.932 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:34:59.936 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:34:59.936 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:34:59.937 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:34:59.937 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:35:04.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:04.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:30.379 INFO:teuthology.orchestra.run.smithi161.stdout:generic/011 30s 2023-08-10T10:35:30.383 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/011 2023-08-10T10:35:30.384 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:35:30.385 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:35:30.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:35:30.578 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-08-10T10:35:30.856 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:35:30.860 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:35:30.860 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:35:30.861 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:35:30.861 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:35:31.266 INFO:teuthology.orchestra.run.smithi161.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:35:31.270 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/012 2023-08-10T10:35:31.270 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/012 2023-08-10T10:35:31.270 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:35:31.272 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:35:31.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:35:31.326 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-08-10T10:35:31.529 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:35:31.532 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:35:31.533 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:35:31.533 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:35:31.534 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:35:34.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:34.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:36:04.429 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:36:04.431 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:36:23.281 INFO:teuthology.orchestra.run.smithi161.stdout:generic/013 52s 2023-08-10T10:36:23.342 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/013 2023-08-10T10:36:23.343 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:36:23.345 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:36:23.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:36:23.374 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-08-10T10:36:23.698 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:36:23.703 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:36:23.704 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:36:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:36:23.705 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:36:34.610 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:36:34.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:04.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:04.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:34.829 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:34.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:04.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:04.962 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:35.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:35.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:05.191 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:05.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:35.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:35.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:05.905 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:05.910 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:36.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:36.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:49.558 INFO:teuthology.orchestra.run.smithi161.stdout:generic/014 266s 2023-08-10T10:40:49.564 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/014 2023-08-10T10:40:49.564 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:49.567 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:49.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:49.610 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-08-10T10:40:49.965 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:49.971 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:49.971 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:49.972 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:49.973 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:50.441 INFO:teuthology.orchestra.run.smithi161.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T10:40:50.446 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/015 2023-08-10T10:40:50.447 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/015 2023-08-10T10:40:50.447 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:50.451 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:50.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:50.484 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-08-10T10:40:50.824 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:50.829 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:50.830 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:50.831 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:50.831 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:51.426 INFO:teuthology.orchestra.run.smithi161.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:40:51.431 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/016 2023-08-10T10:40:51.431 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/016 2023-08-10T10:40:51.431 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:51.433 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:51.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:51.722 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-08-10T10:40:52.093 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:52.098 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:52.098 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:52.099 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:52.099 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:52.576 INFO:teuthology.orchestra.run.smithi161.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T10:40:52.580 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/017 2023-08-10T10:40:52.581 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/017 2023-08-10T10:40:52.581 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:52.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:52.613 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-08-10T10:40:52.949 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:52.952 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:52.955 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:52.957 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:52.957 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:53.586 INFO:teuthology.orchestra.run.smithi161.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-08-10T10:40:53.606 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/018 2023-08-10T10:40:53.607 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/018 2023-08-10T10:40:53.607 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:53.609 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:53.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:53.637 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-08-10T10:40:53.946 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:53.951 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:53.952 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:53.952 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:53.953 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:54.379 INFO:teuthology.orchestra.run.smithi161.stdout:generic/019 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:40:54.384 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/019 2023-08-10T10:40:54.385 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/019 2023-08-10T10:40:54.385 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:54.386 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:54.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:54.419 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-08-10T10:40:54.732 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:54.746 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:54.746 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:54.747 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:58.069 INFO:teuthology.orchestra.run.smithi161.stdout:generic/020 4s 2023-08-10T10:40:58.077 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/020 2023-08-10T10:40:58.078 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:58.080 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:58.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:58.381 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-08-10T10:40:58.752 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:40:58.771 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:40:58.771 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:40:58.772 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:40:58.772 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:59.345 INFO:teuthology.orchestra.run.smithi161.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:40:59.352 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/021 2023-08-10T10:40:59.352 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/021 2023-08-10T10:40:59.352 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:40:59.354 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:40:59.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:40:59.447 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-08-10T10:41:00.023 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:41:00.035 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:41:00.035 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:41:00.036 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:41:00.036 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:00.614 INFO:teuthology.orchestra.run.smithi161.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:41:00.618 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/022 2023-08-10T10:41:00.619 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/022 2023-08-10T10:41:00.619 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:41:00.621 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:00.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:41:00.864 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-08-10T10:41:01.252 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:41:01.256 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:41:01.257 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:41:01.258 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:41:01.258 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:06.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:06.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:36.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:36.338 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:56.374 INFO:teuthology.orchestra.run.smithi161.stdout:generic/023 55s 2023-08-10T10:41:56.381 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/023 2023-08-10T10:41:56.381 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:41:56.383 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:56.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:41:56.735 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-08-10T10:41:57.112 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:41:57.117 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:41:57.117 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:41:57.119 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:41:57.119 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:57.587 INFO:teuthology.orchestra.run.smithi161.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-10T10:41:57.598 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/024 2023-08-10T10:41:57.598 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/024 2023-08-10T10:41:57.599 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:41:57.600 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:57.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:41:57.899 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-08-10T10:41:58.246 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:41:58.250 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:41:58.251 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:41:58.251 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:41:58.252 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:58.712 INFO:teuthology.orchestra.run.smithi161.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-10T10:41:58.716 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/025 2023-08-10T10:41:58.716 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/025 2023-08-10T10:41:58.717 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:41:58.724 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:58.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:41:58.968 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-08-10T10:41:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:41:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:41:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:41:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:41:59.385 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:59.890 INFO:teuthology.orchestra.run.smithi161.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-08-10T10:41:59.898 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/026 2023-08-10T10:41:59.898 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/026 2023-08-10T10:41:59.898 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:41:59.902 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:41:59.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:41:59.952 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-08-10T10:42:00.314 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:00.320 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:00.321 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:00.322 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:00.322 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:00.742 INFO:teuthology.orchestra.run.smithi161.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T10:42:00.753 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/027 2023-08-10T10:42:00.753 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/027 2023-08-10T10:42:00.753 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:00.755 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:00.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:00.776 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-08-10T10:42:01.069 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:01.073 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:01.073 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:01.074 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:01.074 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:06.440 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:06.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:06.523 INFO:teuthology.orchestra.run.smithi161.stdout:generic/028 5s 2023-08-10T10:42:06.559 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/028 2023-08-10T10:42:06.560 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:06.562 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:06.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:06.598 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-08-10T10:42:06.967 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:06.976 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:06.977 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:06.978 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:06.978 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:11.696 INFO:teuthology.orchestra.run.smithi161.stdout:generic/029 4s 2023-08-10T10:42:11.703 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/029 2023-08-10T10:42:11.703 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:11.708 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:11.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:11.719 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-08-10T10:42:12.061 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:12.065 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:12.069 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:12.070 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:12.070 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:16.646 INFO:teuthology.orchestra.run.smithi161.stdout:generic/030 4s 2023-08-10T10:42:16.650 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/030 2023-08-10T10:42:16.651 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:16.652 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:16.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:16.661 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-08-10T10:42:16.876 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:16.880 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:16.883 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:16.883 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:16.883 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:17.241 INFO:teuthology.orchestra.run.smithi161.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-10T10:42:17.245 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/031 2023-08-10T10:42:17.245 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/031 2023-08-10T10:42:17.245 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:17.247 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:17.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:17.273 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-08-10T10:42:17.484 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:17.488 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:17.488 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:17.489 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:17.489 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:17.823 INFO:teuthology.orchestra.run.smithi161.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:17.826 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/032 2023-08-10T10:42:17.827 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/032 2023-08-10T10:42:17.827 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:17.828 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:17.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:17.858 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-08-10T10:42:18.054 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:18.058 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:18.059 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:18.060 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:18.060 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:18.441 INFO:teuthology.orchestra.run.smithi161.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-10T10:42:18.445 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/033 2023-08-10T10:42:18.445 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/033 2023-08-10T10:42:18.445 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:18.447 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:18.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:18.475 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-08-10T10:42:18.680 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:18.685 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:18.685 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:18.686 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:19.003 INFO:teuthology.orchestra.run.smithi161.stdout:generic/034 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:19.007 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/034 2023-08-10T10:42:19.007 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/034 2023-08-10T10:42:19.007 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:19.009 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:19.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:19.032 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-08-10T10:42:19.236 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:19.240 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:19.241 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:19.242 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:19.242 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:19.596 INFO:teuthology.orchestra.run.smithi161.stdout:generic/035 0s 2023-08-10T10:42:19.600 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/035 2023-08-10T10:42:19.600 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:19.602 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:19.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:19.892 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-08-10T10:42:20.122 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:20.126 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:20.126 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:20.127 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:20.127 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:30.531 INFO:teuthology.orchestra.run.smithi161.stdout:generic/036 10s 2023-08-10T10:42:30.537 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/036 2023-08-10T10:42:30.537 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:30.538 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:30.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:30.851 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-08-10T10:42:31.071 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:31.075 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:31.075 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:31.076 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:31.076 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:33.636 INFO:teuthology.orchestra.run.smithi161.stdout:generic/037 2s 2023-08-10T10:42:33.641 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/037 2023-08-10T10:42:33.641 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:33.643 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:33.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:33.651 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-08-10T10:42:33.861 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:33.864 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:33.866 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:34.213 INFO:teuthology.orchestra.run.smithi161.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/038 2023-08-10T10:42:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/038 2023-08-10T10:42:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:34.219 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:34.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:34.242 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-08-10T10:42:34.440 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:34.444 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:34.444 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:34.445 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:34.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:34.744 INFO:teuthology.orchestra.run.smithi161.stdout:generic/039 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:34.748 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/039 2023-08-10T10:42:34.749 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/039 2023-08-10T10:42:34.749 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:34.751 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:34.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:34.772 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-08-10T10:42:34.986 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:34.991 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:34.992 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:34.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:35.339 INFO:teuthology.orchestra.run.smithi161.stdout:generic/040 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/040 2023-08-10T10:42:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/040 2023-08-10T10:42:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:35.345 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:35.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:35.369 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-08-10T10:42:35.562 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:35.566 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:35.567 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:35.568 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:35.568 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:35.925 INFO:teuthology.orchestra.run.smithi161.stdout:generic/041 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:35.928 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/041 2023-08-10T10:42:35.929 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/041 2023-08-10T10:42:35.929 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:35.930 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:35.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:35.959 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-08-10T10:42:36.153 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:36.158 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:36.158 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:36.159 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:36.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:36.572 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:36.624 INFO:teuthology.orchestra.run.smithi161.stdout:generic/042 [not run] ceph does not support shutdown 2023-08-10T10:42:36.643 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/042 2023-08-10T10:42:36.643 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/042 2023-08-10T10:42:36.643 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:36.645 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:36.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:36.664 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-08-10T10:42:36.914 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:36.918 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:36.919 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:36.920 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:36.920 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:37.343 INFO:teuthology.orchestra.run.smithi161.stdout:generic/043 [not run] ceph does not support shutdown 2023-08-10T10:42:37.361 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/043 2023-08-10T10:42:37.362 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/043 2023-08-10T10:42:37.362 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:37.363 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:37.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:37.384 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-08-10T10:42:37.575 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:37.579 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:37.580 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:37.580 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:37.581 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:38.035 INFO:teuthology.orchestra.run.smithi161.stdout:generic/044 [not run] ceph does not support shutdown 2023-08-10T10:42:38.061 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/044 2023-08-10T10:42:38.061 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/044 2023-08-10T10:42:38.061 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:38.063 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:38.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:38.083 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-08-10T10:42:38.283 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:38.288 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:38.288 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:38.289 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:38.289 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:38.762 INFO:teuthology.orchestra.run.smithi161.stdout:generic/045 [not run] ceph does not support shutdown 2023-08-10T10:42:38.785 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/045 2023-08-10T10:42:38.785 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/045 2023-08-10T10:42:38.785 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:38.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:38.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:38.811 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-08-10T10:42:39.010 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:39.013 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:39.014 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:39.015 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:39.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:39.478 INFO:teuthology.orchestra.run.smithi161.stdout:generic/046 [not run] ceph does not support shutdown 2023-08-10T10:42:39.500 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/046 2023-08-10T10:42:39.500 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/046 2023-08-10T10:42:39.500 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:39.502 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:39.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:39.524 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-08-10T10:42:39.750 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:39.755 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:39.755 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:40.242 INFO:teuthology.orchestra.run.smithi161.stdout:generic/047 [not run] ceph does not support shutdown 2023-08-10T10:42:40.259 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/047 2023-08-10T10:42:40.259 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/047 2023-08-10T10:42:40.260 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:40.261 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:40.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:40.289 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-08-10T10:42:40.490 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:40.494 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:40.494 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:40.495 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:40.495 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:40.959 INFO:teuthology.orchestra.run.smithi161.stdout:generic/048 [not run] ceph does not support shutdown 2023-08-10T10:42:40.999 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/048 2023-08-10T10:42:40.999 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/048 2023-08-10T10:42:40.999 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:41.001 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:41.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:41.028 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-08-10T10:42:41.231 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:41.235 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:41.235 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:41.236 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:41.236 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:41.697 INFO:teuthology.orchestra.run.smithi161.stdout:generic/049 [not run] ceph does not support shutdown 2023-08-10T10:42:41.712 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/049 2023-08-10T10:42:41.712 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/049 2023-08-10T10:42:41.713 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:41.714 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:41.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:41.740 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-08-10T10:42:41.943 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:41.947 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:41.947 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:41.948 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:41.948 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:42.440 INFO:teuthology.orchestra.run.smithi161.stdout:generic/050 [not run] ceph does not support shutdown 2023-08-10T10:42:42.464 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/050 2023-08-10T10:42:42.464 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/050 2023-08-10T10:42:42.464 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:42.466 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:42.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:42.490 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-08-10T10:42:42.694 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:42.698 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:42.698 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:42.699 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:42.699 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:43.171 INFO:teuthology.orchestra.run.smithi161.stdout:generic/051 [not run] ceph does not support shutdown 2023-08-10T10:42:43.175 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/051 2023-08-10T10:42:43.175 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/051 2023-08-10T10:42:43.175 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:43.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:43.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:43.202 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-08-10T10:42:43.415 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:43.419 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:43.420 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:43.420 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:43.421 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:43.895 INFO:teuthology.orchestra.run.smithi161.stdout:generic/052 [not run] ceph does not support shutdown 2023-08-10T10:42:43.911 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/052 2023-08-10T10:42:43.912 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/052 2023-08-10T10:42:43.912 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:43.913 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:43.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:43.934 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-08-10T10:42:44.136 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:44.140 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:44.142 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:44.142 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:45.040 INFO:teuthology.orchestra.run.smithi161.stdout:generic/053 1s 2023-08-10T10:42:45.045 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/053 2023-08-10T10:42:45.045 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:45.047 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:45.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:45.057 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-08-10T10:42:45.271 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:45.275 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:45.275 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:45.276 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:45.276 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:45.741 INFO:teuthology.orchestra.run.smithi161.stdout:generic/054 [not run] ceph does not support shutdown 2023-08-10T10:42:45.775 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/054 2023-08-10T10:42:45.775 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/054 2023-08-10T10:42:45.775 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:45.776 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:45.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:45.800 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-08-10T10:42:46.021 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:46.025 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:46.026 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:46.026 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:46.027 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:46.503 INFO:teuthology.orchestra.run.smithi161.stdout:generic/055 [not run] ceph does not support shutdown 2023-08-10T10:42:46.530 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/055 2023-08-10T10:42:46.530 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/055 2023-08-10T10:42:46.530 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:46.532 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:46.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:46.554 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-08-10T10:42:46.757 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:46.760 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:46.761 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:46.762 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:46.762 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:47.108 INFO:teuthology.orchestra.run.smithi161.stdout:generic/056 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:47.111 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/056 2023-08-10T10:42:47.112 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/056 2023-08-10T10:42:47.112 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:47.113 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:47.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:47.140 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-08-10T10:42:47.357 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:47.361 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:47.362 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:47.363 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:47.363 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:47.684 INFO:teuthology.orchestra.run.smithi161.stdout:generic/057 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/057 2023-08-10T10:42:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/057 2023-08-10T10:42:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:47.690 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:47.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:47.720 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-08-10T10:42:47.920 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:47.924 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:47.925 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:47.926 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:47.926 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:48.333 INFO:teuthology.orchestra.run.smithi161.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:48.390 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/058 2023-08-10T10:42:48.390 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/058 2023-08-10T10:42:48.391 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:48.391 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:48.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:48.595 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-08-10T10:42:48.857 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:48.861 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:48.862 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:48.863 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:48.863 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:49.180 INFO:teuthology.orchestra.run.smithi161.stdout:generic/059 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:49.184 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/059 2023-08-10T10:42:49.185 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/059 2023-08-10T10:42:49.185 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:49.186 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:49.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:49.206 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-08-10T10:42:49.415 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:49.419 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:49.420 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:49.421 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:49.421 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:49.862 INFO:teuthology.orchestra.run.smithi161.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:49.866 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/060 2023-08-10T10:42:49.866 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/060 2023-08-10T10:42:49.866 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:49.867 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:50.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:50.182 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-08-10T10:42:50.406 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:50.409 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:50.410 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:50.411 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:50.813 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/061 2023-08-10T10:42:50.813 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/061 2023-08-10T10:42:50.813 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:50.815 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:51.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:51.069 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-08-10T10:42:51.362 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:51.365 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:51.366 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:51.367 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:51.367 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:53.148 INFO:teuthology.orchestra.run.smithi161.stdout:generic/062 2s 2023-08-10T10:42:53.155 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/062 2023-08-10T10:42:53.156 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:53.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:53.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:53.200 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-08-10T10:42:53.438 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:53.442 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:53.443 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:53.444 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:53.444 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:53.891 INFO:teuthology.orchestra.run.smithi161.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:42:53.895 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/063 2023-08-10T10:42:53.895 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/063 2023-08-10T10:42:53.895 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:53.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:54.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:54.051 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-08-10T10:42:54.448 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:54.452 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:54.453 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:54.454 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:54.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:54.766 INFO:teuthology.orchestra.run.smithi161.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T10:42:54.770 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/064 2023-08-10T10:42:54.770 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/064 2023-08-10T10:42:54.770 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:54.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:54.801 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-08-10T10:42:55.001 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:55.005 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:55.006 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:55.006 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:55.006 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:55.354 INFO:teuthology.orchestra.run.smithi161.stdout:generic/065 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:55.357 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/065 2023-08-10T10:42:55.358 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/065 2023-08-10T10:42:55.358 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:55.360 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:55.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:55.391 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-08-10T10:42:55.594 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:55.598 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:55.599 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:55.599 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:55.599 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:55.919 INFO:teuthology.orchestra.run.smithi161.stdout:generic/066 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:55.923 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/066 2023-08-10T10:42:55.924 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/066 2023-08-10T10:42:55.924 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:55.926 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:55.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:55.945 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-08-10T10:42:56.154 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:56.158 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:56.158 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:56.159 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:56.159 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:generic/067 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:42:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/067 2023-08-10T10:42:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/067 2023-08-10T10:42:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:56.501 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:56.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:56.531 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-08-10T10:42:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:56.753 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:57.075 INFO:teuthology.orchestra.run.smithi161.stdout:generic/068 [not run] ceph does not support freezing 2023-08-10T10:42:57.078 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/068 2023-08-10T10:42:57.079 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/068 2023-08-10T10:42:57.079 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:42:57.081 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:42:57.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:42:57.107 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-08-10T10:42:57.313 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:42:57.317 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:42:57.318 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:42:57.319 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:42:57.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:02.880 INFO:teuthology.orchestra.run.smithi161.stdout:generic/069 5s 2023-08-10T10:43:02.887 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/069 2023-08-10T10:43:02.888 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:02.890 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:02.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:02.900 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-08-10T10:43:03.091 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:03.094 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:03.095 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:03.096 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:03.096 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:06.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:06.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:23.234 INFO:teuthology.orchestra.run.smithi161.stdout:generic/070 20s 2023-08-10T10:43:23.239 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/070 2023-08-10T10:43:23.239 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:23.241 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:23.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:23.579 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-08-10T10:43:23.954 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:23.960 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:23.961 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:23.962 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:23.962 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-10T10:43:24.423 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/071 2023-08-10T10:43:24.423 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/071 2023-08-10T10:43:24.423 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:24.425 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:24.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:24.447 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-08-10T10:43:24.808 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:24.812 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:24.813 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:24.814 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:24.815 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:25.400 INFO:teuthology.orchestra.run.smithi161.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-10T10:43:25.404 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/072 2023-08-10T10:43:25.404 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/072 2023-08-10T10:43:25.404 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:25.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:25.456 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-08-10T10:43:25.799 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:25.809 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:25.810 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:25.815 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:25.815 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:26.296 INFO:teuthology.orchestra.run.smithi161.stdout:generic/073 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:43:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/073 2023-08-10T10:43:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/073 2023-08-10T10:43:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:26.304 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:26.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:26.335 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-08-10T10:43:26.647 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:26.651 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:26.652 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:26.657 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:26.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:37.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:37.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:37.531 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T10:43:37.530+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142035) UID: 0 2023-08-10T10:43:37.531 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:43:37.530+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142035) UID: 0 2023-08-10T10:43:44.432 INFO:teuthology.orchestra.run.smithi161.stdout:generic/074 18s 2023-08-10T10:43:44.450 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/074 2023-08-10T10:43:44.451 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:43:44.461 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:43:45.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:43:45.849 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-08-10T10:43:46.256 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:43:46.260 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:43:46.261 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:43:46.267 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:43:46.267 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:22.696 INFO:teuthology.orchestra.run.smithi161.stdout:generic/075 36s 2023-08-10T10:44:22.703 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/075 2023-08-10T10:44:22.703 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:22.706 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:22.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:22.987 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-08-10T10:44:23.337 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:23.342 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:23.343 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:23.344 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:23.344 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:23.816 INFO:teuthology.orchestra.run.smithi161.stdout:generic/076 [not run] require 172.21.15.161:6789:/scratch to be local device 2023-08-10T10:44:23.822 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/076 2023-08-10T10:44:23.823 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/076 2023-08-10T10:44:23.823 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:23.825 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:23.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:23.852 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-08-10T10:44:24.202 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:24.208 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:24.208 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:24.208 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:27.175 INFO:teuthology.orchestra.run.smithi161.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T10:44:27.193 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/077 2023-08-10T10:44:27.193 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/077 2023-08-10T10:44:27.193 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:27.195 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:27.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:27.472 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-08-10T10:44:27.799 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:27.804 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:27.804 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:28.303 INFO:teuthology.orchestra.run.smithi161.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-10T10:44:28.308 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/078 2023-08-10T10:44:28.308 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/078 2023-08-10T10:44:28.308 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:28.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:28.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:28.570 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-08-10T10:44:28.940 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:28.948 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:28.950 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:28.950 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:29.447 INFO:teuthology.orchestra.run.smithi161.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-10T10:44:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/079 2023-08-10T10:44:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/079 2023-08-10T10:44:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:29.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:29.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:29.495 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-08-10T10:44:29.792 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:29.803 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:29.803 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:29.804 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:29.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:32.327 INFO:teuthology.orchestra.run.smithi161.stdout:generic/080 2s 2023-08-10T10:44:32.351 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/080 2023-08-10T10:44:32.351 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:32.353 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:32.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:32.406 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-08-10T10:44:32.731 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:32.737 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:32.738 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:32.739 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:32.739 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:33.245 INFO:teuthology.orchestra.run.smithi161.stdout:generic/081 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:44:33.254 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/081 2023-08-10T10:44:33.255 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/081 2023-08-10T10:44:33.255 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:33.259 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:33.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:33.294 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-08-10T10:44:33.592 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:33.597 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:33.601 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:33.602 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:33.602 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:34.098 INFO:teuthology.orchestra.run.smithi161.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T10:44:34.108 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/082 2023-08-10T10:44:34.109 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/082 2023-08-10T10:44:34.109 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:34.111 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:34.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:34.138 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-08-10T10:44:34.485 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:34.490 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:34.490 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:34.915 INFO:teuthology.orchestra.run.smithi161.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T10:44:34.919 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/083 2023-08-10T10:44:34.919 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/083 2023-08-10T10:44:34.919 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:34.921 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:34.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:34.949 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-08-10T10:44:35.253 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:35.259 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:35.259 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:35.260 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:35.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:41.225 INFO:teuthology.orchestra.run.smithi161.stdout:generic/084 6s 2023-08-10T10:44:41.235 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/084 2023-08-10T10:44:41.235 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:41.238 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:41.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:41.282 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-08-10T10:44:41.681 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:41.689 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:41.690 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:41.691 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:41.691 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:42.169 INFO:teuthology.orchestra.run.smithi161.stdout:generic/085 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:44:42.175 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/085 2023-08-10T10:44:42.175 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/085 2023-08-10T10:44:42.175 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:42.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:42.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:42.210 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-08-10T10:44:42.505 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:42.510 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:42.510 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:42.511 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:42.511 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:43.004 INFO:teuthology.orchestra.run.smithi161.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:44:43.008 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/086 2023-08-10T10:44:43.008 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/086 2023-08-10T10:44:43.008 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:43.010 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:43.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:43.036 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-08-10T10:44:43.336 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:43.340 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:43.341 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:43.342 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:43.342 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:43.962 INFO:teuthology.orchestra.run.smithi161.stdout:generic/087 0s 2023-08-10T10:44:43.971 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/087 2023-08-10T10:44:43.971 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:43.973 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:44.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:44.169 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-08-10T10:44:44.672 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:44.676 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:44.677 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:44.678 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:44.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:45.241 INFO:teuthology.orchestra.run.smithi161.stdout:generic/088 1s 2023-08-10T10:44:45.287 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/088 2023-08-10T10:44:45.288 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:44:45.290 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:44:45.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:44:45.546 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-08-10T10:44:45.922 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:44:45.928 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:44:45.928 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:44:45.929 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:44:45.929 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:46:39.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:46:39.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:10.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:10.151 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:40.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:40.680 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:10.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:10.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:41.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:41.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:11.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:11.213 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:11.431 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:49:11.431+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142213) UID: 0 2023-08-10T10:49:11.431 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T10:49:11.431+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142213) UID: 0 2023-08-10T10:52:12.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:12.335 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:42.618 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:42.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:12.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:12.676 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:12.722 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T10:53:12.721+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142318) UID: 0 2023-08-10T10:53:12.722 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T10:53:12.721+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 142318) UID: 0 2023-08-10T10:53:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:generic/089 514s 2023-08-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/089 2023-08-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:53:20.745 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:53:21.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:53:21.500 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-08-10T10:53:22.130 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:53:22.135 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:53:22.136 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:53:22.137 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:53:22.137 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:53:22.734 INFO:teuthology.orchestra.run.smithi161.stdout:generic/090 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:53:22.738 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/090 2023-08-10T10:53:22.738 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/090 2023-08-10T10:53:22.738 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:53:22.740 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:53:22.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:53:22.766 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-08-10T10:53:22.981 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:53:22.985 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:53:22.986 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:53:22.987 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:53:22.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:05.846 INFO:teuthology.orchestra.run.smithi161.stdout:generic/091 102s 2023-08-10T10:55:05.850 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/091 2023-08-10T10:55:05.850 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:05.852 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:06.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:06.216 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-08-10T10:55:06.440 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:06.776 INFO:teuthology.orchestra.run.smithi161.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:55:06.780 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/092 2023-08-10T10:55:06.780 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/092 2023-08-10T10:55:06.780 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:06.782 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:06.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:06.806 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-08-10T10:55:07.031 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:07.035 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:07.035 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:07.036 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:07.036 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:07.524 INFO:teuthology.orchestra.run.smithi161.stdout:generic/093 0s 2023-08-10T10:55:07.529 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/093 2023-08-10T10:55:07.530 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:07.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:07.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:07.875 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-08-10T10:55:08.119 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:08.122 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:08.123 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:08.124 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:08.124 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:08.499 INFO:teuthology.orchestra.run.smithi161.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T10:55:08.503 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/094 2023-08-10T10:55:08.503 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/094 2023-08-10T10:55:08.503 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:08.505 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:08.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:08.815 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-08-10T10:55:09.076 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:09.079 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:09.080 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:09.081 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:09.081 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:21.110 INFO:teuthology.orchestra.run.smithi161.stdout:generic/095 12s 2023-08-10T10:55:21.121 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/095 2023-08-10T10:55:21.121 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:21.126 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:21.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:21.135 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-08-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:21.750 INFO:teuthology.orchestra.run.smithi161.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-10T10:55:21.754 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/096 2023-08-10T10:55:21.754 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/096 2023-08-10T10:55:21.754 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:21.756 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:21.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:21.783 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-08-10T10:55:21.993 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:21.997 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:21.997 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:21.998 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:21.998 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:22.808 INFO:teuthology.orchestra.run.smithi161.stdout:generic/097 0s 2023-08-10T10:55:22.813 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/097 2023-08-10T10:55:22.813 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:22.815 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:22.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:22.838 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-08-10T10:55:23.051 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:23.055 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:23.055 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:23.056 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:23.056 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:25.431 INFO:teuthology.orchestra.run.smithi161.stdout:generic/098 2s 2023-08-10T10:55:25.436 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/098 2023-08-10T10:55:25.436 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:25.438 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:25.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:25.446 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-08-10T10:55:25.665 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:25.670 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:25.670 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:25.671 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:25.671 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:26.565 INFO:teuthology.orchestra.run.smithi161.stdout:generic/099 1s 2023-08-10T10:55:26.577 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/099 2023-08-10T10:55:26.577 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:26.579 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:26.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:26.816 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-08-10T10:55:27.162 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:27.166 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:27.166 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:27.167 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:27.167 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:41.745 INFO:teuthology.orchestra.run.smithi161.stdout:generic/100 14s 2023-08-10T10:55:41.750 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/100 2023-08-10T10:55:41.750 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:42.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:42.712 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-08-10T10:55:43.010 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:43.014 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:43.014 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:43.015 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:43.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:43.362 INFO:teuthology.orchestra.run.smithi161.stdout:generic/101 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:55:43.366 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/101 2023-08-10T10:55:43.366 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/101 2023-08-10T10:55:43.366 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:43.368 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:43.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:43.393 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-08-10T10:55:43.611 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:43.615 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:43.616 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:43.616 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:43.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:43.929 INFO:teuthology.orchestra.run.smithi161.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T10:55:43.932 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/102 2023-08-10T10:55:43.933 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/102 2023-08-10T10:55:43.933 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:43.935 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:43.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:43.957 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-08-10T10:55:44.162 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:44.166 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:44.166 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:44.167 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:44.168 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:44.527 INFO:teuthology.orchestra.run.smithi161.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T10:55:44.531 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/103 2023-08-10T10:55:44.531 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/103 2023-08-10T10:55:44.531 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:44.533 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:44.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:44.831 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-08-10T10:55:45.092 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:45.095 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:45.096 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:45.097 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:45.448 INFO:teuthology.orchestra.run.smithi161.stdout:generic/104 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:55:45.452 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/104 2023-08-10T10:55:45.452 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/104 2023-08-10T10:55:45.453 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:45.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:45.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:45.484 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-08-10T10:55:45.677 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:45.681 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:45.681 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:45.682 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:46.650 INFO:teuthology.orchestra.run.smithi161.stdout:generic/105 1s 2023-08-10T10:55:46.661 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/105 2023-08-10T10:55:46.661 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:46.663 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:46.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:46.673 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-08-10T10:55:46.874 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:46.878 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:46.879 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:46.880 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:46.880 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:47.248 INFO:teuthology.orchestra.run.smithi161.stdout:generic/106 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:55:47.252 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/106 2023-08-10T10:55:47.252 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/106 2023-08-10T10:55:47.252 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:47.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:47.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:47.277 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-08-10T10:55:47.500 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:47.504 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:47.504 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:47.505 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:47.505 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:47.863 INFO:teuthology.orchestra.run.smithi161.stdout:generic/107 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:55:47.867 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/107 2023-08-10T10:55:47.867 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/107 2023-08-10T10:55:47.868 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:47.869 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:47.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:47.894 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-08-10T10:55:48.088 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:48.092 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:48.093 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:48.093 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:48.093 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:48.536 INFO:teuthology.orchestra.run.smithi161.stdout:generic/108 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T10:55:48.539 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/108 2023-08-10T10:55:48.540 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/108 2023-08-10T10:55:48.540 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:48.542 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:48.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:48.582 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-08-10T10:55:48.787 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:55:48.791 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:55:48.792 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:55:48.793 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:55:48.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:56.146 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:55:56.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:55:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:generic/109 10s 2023-08-10T10:55:59.599 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/109 2023-08-10T10:55:59.600 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:55:59.603 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:55:59.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:55:59.626 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-08-10T10:56:00.538 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:00.543 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:00.544 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:00.545 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:21.814 INFO:teuthology.orchestra.run.smithi161.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:56:21.818 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/110 2023-08-10T10:56:21.818 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/110 2023-08-10T10:56:21.818 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:21.820 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:22.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:22.277 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-08-10T10:56:22.758 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:22.761 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:22.762 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:23.108 INFO:teuthology.orchestra.run.smithi161.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:56:23.112 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/111 2023-08-10T10:56:23.112 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/111 2023-08-10T10:56:23.113 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:23.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:23.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:23.474 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-08-10T10:56:23.685 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:23.689 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:23.689 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:23.690 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:23.691 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:26.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:56:26.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:56:39.440 INFO:teuthology.orchestra.run.smithi161.stdout:generic/112 16s 2023-08-10T10:56:39.444 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/112 2023-08-10T10:56:39.445 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:39.446 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:39.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:39.792 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-08-10T10:56:40.037 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:40.041 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:40.042 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:40.043 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:40.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:54.216 INFO:teuthology.orchestra.run.smithi161.stdout:generic/113 14s 2023-08-10T10:56:54.221 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/113 2023-08-10T10:56:54.221 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:54.223 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:54.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:54.319 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-08-10T10:56:54.777 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:54.781 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:54.781 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:54.782 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:55.301 INFO:teuthology.orchestra.run.smithi161.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-08-10T10:56:55.305 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/114 2023-08-10T10:56:55.305 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/114 2023-08-10T10:56:55.305 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:55.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:55.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:55.335 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-08-10T10:56:55.539 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:55.543 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:55.544 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:55.545 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:55.545 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:56:55.910 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/115 2023-08-10T10:56:55.911 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/115 2023-08-10T10:56:55.911 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:55.912 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:56.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:56.291 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-08-10T10:56:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:56.511 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:56.511 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:56.512 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:56.512 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:56.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:56:56.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:56:56.862 INFO:teuthology.orchestra.run.smithi161.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:56:56.866 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/116 2023-08-10T10:56:56.866 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/116 2023-08-10T10:56:56.866 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:56:56.868 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:56:57.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:56:57.011 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-08-10T10:56:57.463 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:56:57.467 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:56:57.468 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:56:57.469 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:56:57.469 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:07.694 INFO:teuthology.orchestra.run.smithi161.stdout:generic/117 10s 2023-08-10T10:57:07.703 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/117 2023-08-10T10:57:07.703 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:07.705 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:07.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:07.713 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-08-10T10:57:07.946 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:07.953 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:07.957 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:07.963 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:07.963 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:08.774 INFO:teuthology.orchestra.run.smithi161.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:57:08.778 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/118 2023-08-10T10:57:08.779 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/118 2023-08-10T10:57:08.779 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:08.780 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:09.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:09.107 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-08-10T10:57:09.450 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:09.454 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:09.454 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:09.455 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:09.455 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:09.806 INFO:teuthology.orchestra.run.smithi161.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T10:57:09.810 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/119 2023-08-10T10:57:09.810 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/119 2023-08-10T10:57:09.810 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:09.812 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:10.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:10.134 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-08-10T10:57:10.378 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:10.382 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:10.382 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:10.383 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:10.383 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:generic/120 [not run] atime not maintained by ceph 2023-08-10T10:57:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/120 2023-08-10T10:57:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/120 2023-08-10T10:57:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:10.709 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:10.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:10.739 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-08-10T10:57:10.940 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:10.944 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:10.946 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:10.946 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:10.946 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:11.273 INFO:teuthology.orchestra.run.smithi161.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T10:57:11.277 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/121 2023-08-10T10:57:11.277 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/121 2023-08-10T10:57:11.277 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:11.279 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:11.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:11.639 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-08-10T10:57:11.868 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:11.872 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:11.873 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:11.873 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:11.873 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:12.210 INFO:teuthology.orchestra.run.smithi161.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T10:57:12.214 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/122 2023-08-10T10:57:12.214 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/122 2023-08-10T10:57:12.215 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:12.216 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:12.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:12.479 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-08-10T10:57:12.805 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:12.809 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:12.809 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:12.810 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:12.810 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:13.297 INFO:teuthology.orchestra.run.smithi161.stdout:generic/123 0s 2023-08-10T10:57:13.302 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/123 2023-08-10T10:57:13.302 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:13.304 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:13.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:13.593 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-08-10T10:57:13.854 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:13.858 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:13.858 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:13.859 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:13.859 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:16.113 INFO:teuthology.orchestra.run.smithi161.stdout:generic/124 2s 2023-08-10T10:57:16.128 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/124 2023-08-10T10:57:16.128 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:57:16.141 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:16.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:57:16.833 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-08-10T10:57:17.101 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:57:17.105 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:57:17.105 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:57:17.106 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:57:17.106 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:57:26.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:57:26.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:57:57.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:57:57.073 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:58:18.585 INFO:teuthology.orchestra.run.smithi161.stdout:generic/125 61s 2023-08-10T10:58:18.591 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/125 2023-08-10T10:58:18.591 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:58:18.594 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:58:18.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:58:18.953 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-08-10T10:58:19.209 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:58:19.213 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:58:19.214 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:58:19.215 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:58:19.215 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:58:19.699 INFO:teuthology.orchestra.run.smithi161.stdout:generic/126 0s 2023-08-10T10:58:19.703 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/126 2023-08-10T10:58:19.704 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T10:58:19.705 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:58:20.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T10:58:20.046 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-08-10T10:58:20.322 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T10:58:20.326 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T10:58:20.327 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T10:58:20.328 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T10:58:20.328 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T10:58:27.225 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:58:27.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:58:57.305 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:58:57.308 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:59:27.368 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:59:27.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:59:57.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:59:57.497 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:00:27.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:00:27.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:00:57.614 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:00:57.616 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:01:27.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:01:27.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:01:57.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:01:57.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:02:28.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:02:28.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:02:58.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:02:58.076 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:03:28.131 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:03:28.134 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:03:58.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:03:58.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:04:28.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:04:28.545 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:04:58.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:04:58.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:05:28.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:05:28.747 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:05:58.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:05:58.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:06:29.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:06:29.048 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:06:59.119 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:06:59.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:07:29.250 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:07:29.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:07:37.055 INFO:teuthology.orchestra.run.smithi161.stdout:generic/127 557s 2023-08-10T11:07:37.059 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/127 2023-08-10T11:07:37.060 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:07:37.062 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:07:37.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:07:37.434 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-08-10T11:07:37.674 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:07:37.678 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:07:37.679 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:07:37.679 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:07:37.680 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:07:38.746 INFO:teuthology.orchestra.run.smithi161.stdout:generic/128 1s 2023-08-10T11:07:38.753 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/128 2023-08-10T11:07:38.753 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:07:38.755 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:07:38.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:07:38.763 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-08-10T11:07:38.997 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:07:39.001 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:07:39.002 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:07:39.003 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:07:39.003 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:07:59.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:07:59.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:08:29.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:08:29.431 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:08:59.553 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:08:59.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:09:29.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:09:29.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:09:59.762 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:09:59.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:10:29.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:10:29.910 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:11:00.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:11:00.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:11:30.558 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:11:30.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:12:00.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:12:00.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:12:30.816 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:12:30.819 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:13:00.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:13:00.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:13:31.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:13:31.086 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:14:01.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:14:01.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:14:31.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:14:31.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:15:02.051 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:15:02.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:15:32.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:15:32.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:16:02.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:16:02.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:16:32.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:16:32.533 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:17:02.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:17:02.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:17:32.969 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:17:32.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:18:03.366 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:18:03.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:18:33.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:18:33.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:19:04.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:19:04.280 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:19:34.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:19:34.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:20:04.588 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:20:04.598 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:20:34.796 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:20:34.817 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:21:05.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:21:05.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:21:35.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:21:35.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:22:05.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:22:05.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:22:05.764 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:22:05.761+0000 7fa60693b700 -1 Fail to open '/proc/286235/cmdline' error = (2) No such file or directory 2023-08-10T11:22:05.764 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:22:05.761+0000 7fa60693b700 -1 received signal: Hangup from (PID: 286235) UID: 0 2023-08-10T11:22:05.775 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:22:05.761+0000 7f91d129e700 -1 Fail to open '/proc/286235/cmdline' error = (2) No such file or directory 2023-08-10T11:22:05.775 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:22:05.761+0000 7f91d129e700 -1 received signal: Hangup from (PID: 286235) UID: 0 2023-08-10T11:22:05.776 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:22:05.768+0000 7f6ff6f5a700 -1 Fail to open '/proc/286235/cmdline' error = (2) No such file or directory 2023-08-10T11:22:05.776 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:22:05.768+0000 7f6ff6f5a700 -1 received signal: Hangup from (PID: 286235) UID: 0 2023-08-10T11:22:05.776 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T11:22:05.759+0000 7fbfda245700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 286235) UID: 0 2023-08-10T11:26:04.661 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:26:04.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:26:04.908 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T11:26:04.895+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144475) UID: 0 2023-08-10T11:26:04.909 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T11:26:04.895+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144475) UID: 0 2023-08-10T11:26:04.909 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T11:26:04.908+0000 7fd95f661700 -1 Fail to open '/proc/144475/cmdline' error = (2) No such file or directory 2023-08-10T11:26:04.910 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T11:26:04.908+0000 7fd95f661700 -1 received signal: Hangup from (PID: 144475) UID: 0 2023-08-10T11:26:04.915 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T11:26:04.895+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144475) UID: 0 2023-08-10T11:26:06.013 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:26:06.010+0000 7f91d129e700 -1 Fail to open '/proc/286294/cmdline' error = (2) No such file or directory 2023-08-10T11:26:06.013 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:26:06.010+0000 7f91d129e700 -1 received signal: Hangup from (PID: 286294) UID: 0 2023-08-10T11:26:06.015 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:26:06.013+0000 7f6ff6f5a700 -1 Fail to open '/proc/286294/cmdline' error = (2) No such file or directory 2023-08-10T11:26:06.015 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:26:06.013+0000 7f6ff6f5a700 -1 received signal: Hangup from (PID: 286294) UID: 0 2023-08-10T11:26:06.023 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:26:06.021+0000 7fa60693b700 -1 Fail to open '/proc/286294/cmdline' error = (2) No such file or directory 2023-08-10T11:26:06.023 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:26:06.021+0000 7fa60693b700 -1 received signal: Hangup from (PID: 286294) UID: 0 2023-08-10T11:26:06.026 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T11:26:06.021+0000 7fbfda245700 -1 Fail to open '/proc/286294/cmdline' error = (2) No such file or directory 2023-08-10T11:26:06.027 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T11:26:06.021+0000 7fbfda245700 -1 received signal: Hangup from (PID: 286294) UID: 0 2023-08-10T11:27:01.583 INFO:teuthology.orchestra.run.smithi161.stdout:generic/129 1162s 2023-08-10T11:27:01.665 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/129 2023-08-10T11:27:01.665 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:27:01.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:01.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:27:01.685 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-08-10T11:27:02.486 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:27:02.490 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:27:02.491 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:27:02.492 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:27:02.492 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:17.582 INFO:teuthology.orchestra.run.smithi161.stdout:generic/130 15s 2023-08-10T11:27:17.633 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/130 2023-08-10T11:27:17.634 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:27:17.636 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:17.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:27:17.644 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-08-10T11:27:17.850 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:27:17.853 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:27:17.854 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:27:17.855 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:27:17.855 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:20.049 INFO:teuthology.orchestra.run.smithi161.stdout:generic/131 2s 2023-08-10T11:27:20.055 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/131 2023-08-10T11:27:20.055 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:27:20.057 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:20.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:27:20.443 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-08-10T11:27:20.880 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:27:20.893 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:27:20.894 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:27:20.895 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:27:20.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:34.675 INFO:teuthology.orchestra.run.smithi161.stdout:generic/132 13s 2023-08-10T11:27:34.680 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/132 2023-08-10T11:27:34.681 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:27:34.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:27:34.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:27:34.691 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-08-10T11:27:34.900 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:27:34.904 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:27:34.905 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:27:34.905 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:27:34.906 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:28:56.923 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:28:56.926 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:29:27.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:29:27.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:29:27.170 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T11:29:27.169+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144802) UID: 0 2023-08-10T11:29:27.170 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T11:29:27.169+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144802) UID: 0 2023-08-10T11:29:27.171 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T11:29:27.169+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144802) UID: 0 2023-08-10T11:29:27.171 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T11:29:27.169+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144802) UID: 0 2023-08-10T11:31:34.614 INFO:teuthology.orchestra.run.smithi161.stdout:generic/133 239s 2023-08-10T11:31:34.619 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/133 2023-08-10T11:31:34.619 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:34.621 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:34.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:34.982 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-08-10T11:31:35.218 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:35.222 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:35.222 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:35.223 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:35.223 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:35.736 INFO:teuthology.orchestra.run.smithi161.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:35.740 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/134 2023-08-10T11:31:35.741 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/134 2023-08-10T11:31:35.741 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:35.742 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:36.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:36.100 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-08-10T11:31:36.373 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:36.377 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:36.378 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:36.379 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:36.379 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:37.530 INFO:teuthology.orchestra.run.smithi161.stdout:generic/135 1s 2023-08-10T11:31:37.535 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/135 2023-08-10T11:31:37.535 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:37.537 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:37.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:37.546 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-08-10T11:31:37.747 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:37.750 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:37.751 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:37.752 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:37.752 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:38.099 INFO:teuthology.orchestra.run.smithi161.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T11:31:38.103 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/136 2023-08-10T11:31:38.103 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/136 2023-08-10T11:31:38.104 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:38.105 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:38.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:38.280 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-08-10T11:31:38.694 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:38.699 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:38.699 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:38.700 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:38.700 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:39.050 INFO:teuthology.orchestra.run.smithi161.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:39.054 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/137 2023-08-10T11:31:39.055 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/137 2023-08-10T11:31:39.055 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:39.056 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:39.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:39.288 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-08-10T11:31:39.640 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:39.644 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:39.644 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:39.645 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:39.645 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:39.977 INFO:teuthology.orchestra.run.smithi161.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:39.981 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/138 2023-08-10T11:31:39.981 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/138 2023-08-10T11:31:39.982 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:39.983 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:40.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:40.311 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-08-10T11:31:40.575 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:40.579 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:40.580 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:40.580 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:40.581 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:40.942 INFO:teuthology.orchestra.run.smithi161.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:40.946 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/139 2023-08-10T11:31:40.946 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/139 2023-08-10T11:31:40.946 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:40.948 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:41.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:41.068 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-08-10T11:31:41.550 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:41.554 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:41.554 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:41.555 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:41.555 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:41.917 INFO:teuthology.orchestra.run.smithi161.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:41.921 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/140 2023-08-10T11:31:41.922 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/140 2023-08-10T11:31:41.922 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:41.924 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:42.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:42.303 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-08-10T11:31:42.522 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:42.526 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:42.527 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:42.528 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:42.528 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:43.093 INFO:teuthology.orchestra.run.smithi161.stdout:generic/141 1s 2023-08-10T11:31:43.098 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/141 2023-08-10T11:31:43.098 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:43.100 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:43.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:43.109 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-08-10T11:31:43.327 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:43.331 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:43.331 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:43.332 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:43.332 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:43.696 INFO:teuthology.orchestra.run.smithi161.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:43.700 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/142 2023-08-10T11:31:43.700 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/142 2023-08-10T11:31:43.700 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:43.702 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:43.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:43.975 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-08-10T11:31:44.279 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:44.283 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:44.283 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:44.284 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:44.284 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:44.632 INFO:teuthology.orchestra.run.smithi161.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:44.636 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/143 2023-08-10T11:31:44.636 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/143 2023-08-10T11:31:44.636 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:44.638 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:45.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:45.015 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-08-10T11:31:45.223 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:45.227 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:45.228 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:45.229 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:45.595 INFO:teuthology.orchestra.run.smithi161.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/144 2023-08-10T11:31:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/144 2023-08-10T11:31:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:45.601 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:45.630 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:31:45.662 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:31:45.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:45.838 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-08-10T11:31:46.193 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:46.197 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:46.198 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:46.198 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:46.199 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:46.533 INFO:teuthology.orchestra.run.smithi161.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:46.537 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/145 2023-08-10T11:31:46.537 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/145 2023-08-10T11:31:46.537 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:46.539 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:46.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:46.899 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-08-10T11:31:47.123 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:47.127 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:47.128 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:47.129 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:47.129 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:47.490 INFO:teuthology.orchestra.run.smithi161.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:47.494 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/146 2023-08-10T11:31:47.494 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/146 2023-08-10T11:31:47.494 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:47.496 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:47.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:47.871 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-08-10T11:31:48.106 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:48.110 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:48.111 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:48.111 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:48.480 INFO:teuthology.orchestra.run.smithi161.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:48.484 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/147 2023-08-10T11:31:48.484 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/147 2023-08-10T11:31:48.485 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:48.486 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:48.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:48.856 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-08-10T11:31:49.077 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:49.081 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:49.081 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:49.082 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:49.082 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:49.448 INFO:teuthology.orchestra.run.smithi161.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:49.452 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/148 2023-08-10T11:31:49.452 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/148 2023-08-10T11:31:49.452 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:49.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:49.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:49.800 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-08-10T11:31:50.055 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:50.060 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:50.060 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:50.061 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:50.061 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:50.435 INFO:teuthology.orchestra.run.smithi161.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:50.438 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/149 2023-08-10T11:31:50.439 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/149 2023-08-10T11:31:50.439 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:50.440 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:50.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:50.818 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-08-10T11:31:51.043 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:51.047 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:51.048 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:51.048 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:51.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:51.418 INFO:teuthology.orchestra.run.smithi161.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:51.422 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/150 2023-08-10T11:31:51.422 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/150 2023-08-10T11:31:51.423 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:51.424 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:51.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:51.794 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-08-10T11:31:52.035 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:52.039 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:52.039 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:52.040 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:52.041 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:52.393 INFO:teuthology.orchestra.run.smithi161.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:52.397 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/151 2023-08-10T11:31:52.397 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/151 2023-08-10T11:31:52.397 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:52.399 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:52.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:52.630 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-08-10T11:31:52.985 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:52.989 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:52.989 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:52.990 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:52.990 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:53.334 INFO:teuthology.orchestra.run.smithi161.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:53.338 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/152 2023-08-10T11:31:53.338 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/152 2023-08-10T11:31:53.339 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:53.340 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:53.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:53.670 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-08-10T11:31:53.949 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:53.952 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:53.953 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:53.954 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:53.954 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:54.304 INFO:teuthology.orchestra.run.smithi161.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:54.308 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/153 2023-08-10T11:31:54.308 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/153 2023-08-10T11:31:54.309 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:54.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:54.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:54.641 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-08-10T11:31:54.878 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:54.883 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:54.884 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:54.884 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:54.885 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:55.213 INFO:teuthology.orchestra.run.smithi161.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:55.217 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/154 2023-08-10T11:31:55.217 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/154 2023-08-10T11:31:55.218 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:55.219 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:55.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:55.584 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-08-10T11:31:55.815 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:55.819 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:55.820 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:55.821 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:55.822 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:56.183 INFO:teuthology.orchestra.run.smithi161.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:56.187 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/155 2023-08-10T11:31:56.188 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/155 2023-08-10T11:31:56.188 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:56.189 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:56.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:56.549 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-08-10T11:31:56.798 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:56.802 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:56.803 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:56.804 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:56.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:57.159 INFO:teuthology.orchestra.run.smithi161.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:57.163 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/156 2023-08-10T11:31:57.163 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/156 2023-08-10T11:31:57.163 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:57.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:57.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:57.435 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-08-10T11:31:57.749 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:57.753 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:57.753 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:57.754 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:57.754 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:58.103 INFO:teuthology.orchestra.run.smithi161.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:31:58.106 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/157 2023-08-10T11:31:58.107 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/157 2023-08-10T11:31:58.107 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:58.108 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:58.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:58.458 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-08-10T11:31:58.687 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:58.692 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:58.692 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:58.693 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:58.693 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:59.051 INFO:teuthology.orchestra.run.smithi161.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T11:31:59.055 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/158 2023-08-10T11:31:59.056 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/158 2023-08-10T11:31:59.056 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:59.057 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:59.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:31:59.355 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-08-10T11:31:59.638 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:31:59.642 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:31:59.643 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:31:59.644 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:31:59.644 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:31:59.991 INFO:teuthology.orchestra.run.smithi161.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-08-10T11:31:59.994 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/159 2023-08-10T11:31:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/159 2023-08-10T11:31:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:31:59.997 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:00.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:00.025 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-08-10T11:32:00.242 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:00.246 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:00.247 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:00.248 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:00.248 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:00.586 INFO:teuthology.orchestra.run.smithi161.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-08-10T11:32:00.590 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/160 2023-08-10T11:32:00.590 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/160 2023-08-10T11:32:00.590 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:00.592 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:00.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:00.620 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-08-10T11:32:00.837 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:00.841 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:00.841 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:00.842 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:00.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:01.584 INFO:teuthology.orchestra.run.smithi161.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:01.658 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/161 2023-08-10T11:32:01.658 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/161 2023-08-10T11:32:01.658 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:01.689 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:01.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:01.750 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-08-10T11:32:01.961 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:01.965 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:01.966 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:01.966 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:01.967 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:02.486 INFO:teuthology.orchestra.run.smithi161.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-08-10T11:32:02.704 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/162 2023-08-10T11:32:02.704 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/162 2023-08-10T11:32:02.705 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:02.811 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:02.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:02.930 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-08-10T11:32:03.130 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:03.134 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:03.134 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:03.135 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:03.135 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:03.668 INFO:teuthology.orchestra.run.smithi161.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-08-10T11:32:03.928 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/163 2023-08-10T11:32:03.929 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/163 2023-08-10T11:32:03.929 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:04.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:04.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:04.135 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-08-10T11:32:04.337 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:04.341 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:04.342 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:04.342 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:04.343 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:05.194 INFO:teuthology.orchestra.run.smithi161.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/164 2023-08-10T11:32:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/164 2023-08-10T11:32:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:05.240 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:05.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:05.308 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-08-10T11:32:05.511 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:05.514 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:05.515 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:05.516 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:05.516 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:06.262 INFO:teuthology.orchestra.run.smithi161.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:06.269 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/165 2023-08-10T11:32:06.269 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/165 2023-08-10T11:32:06.270 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:06.272 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:06.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:06.444 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-08-10T11:32:06.664 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:06.668 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:06.668 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:06.669 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:06.669 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:07.334 INFO:teuthology.orchestra.run.smithi161.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:07.421 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/166 2023-08-10T11:32:07.421 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/166 2023-08-10T11:32:07.421 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:07.423 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:07.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:07.615 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-08-10T11:32:07.834 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:07.838 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:07.838 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:07.839 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:07.839 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:08.695 INFO:teuthology.orchestra.run.smithi161.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:08.707 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/167 2023-08-10T11:32:08.707 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/167 2023-08-10T11:32:08.707 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:08.733 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:08.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:08.792 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-08-10T11:32:08.990 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:08.994 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:08.995 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:08.996 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:08.996 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:09.845 INFO:teuthology.orchestra.run.smithi161.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:09.861 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/168 2023-08-10T11:32:09.861 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/168 2023-08-10T11:32:09.861 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:09.882 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:09.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:09.910 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-08-10T11:32:10.120 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:10.124 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:10.126 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:10.928 INFO:teuthology.orchestra.run.smithi161.stdout:generic/169 0s 2023-08-10T11:32:10.932 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/169 2023-08-10T11:32:10.933 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:10.934 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:10.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:10.943 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-08-10T11:32:11.161 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:11.165 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:11.165 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:11.166 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:11.167 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:12.026 INFO:teuthology.orchestra.run.smithi161.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:12.036 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/170 2023-08-10T11:32:12.036 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/170 2023-08-10T11:32:12.036 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:12.041 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:12.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:12.131 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-08-10T11:32:12.345 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:12.349 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:12.350 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:12.351 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:12.351 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:13.222 INFO:teuthology.orchestra.run.smithi161.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:13.237 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/171 2023-08-10T11:32:13.238 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/171 2023-08-10T11:32:13.238 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:13.240 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:13.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:13.298 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-08-10T11:32:13.501 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:13.505 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:13.505 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:13.506 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:14.307 INFO:teuthology.orchestra.run.smithi161.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:14.313 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/172 2023-08-10T11:32:14.313 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/172 2023-08-10T11:32:14.314 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:14.324 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:14.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:14.496 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-08-10T11:32:14.710 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:14.714 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:14.714 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:14.715 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:14.715 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:15.564 INFO:teuthology.orchestra.run.smithi161.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:15.592 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/173 2023-08-10T11:32:15.592 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/173 2023-08-10T11:32:15.592 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:15.595 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:15.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:15.730 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-08-10T11:32:15.929 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:15.934 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:15.934 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:15.935 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:15.935 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:16.042 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:32:16.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:32:16.578 INFO:teuthology.orchestra.run.smithi161.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:16.652 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/174 2023-08-10T11:32:16.652 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/174 2023-08-10T11:32:16.652 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:16.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:16.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:16.936 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-08-10T11:32:17.179 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:17.183 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:17.183 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:17.184 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:17.184 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:18.060 INFO:teuthology.orchestra.run.smithi161.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:18.089 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/175 2023-08-10T11:32:18.089 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/175 2023-08-10T11:32:18.089 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:18.093 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:18.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:18.126 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-08-10T11:32:18.358 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:18.362 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:18.362 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:18.363 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:18.363 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:19.189 INFO:teuthology.orchestra.run.smithi161.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:19.197 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/176 2023-08-10T11:32:19.197 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/176 2023-08-10T11:32:19.197 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:19.204 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:19.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:19.291 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-08-10T11:32:19.512 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:19.516 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:19.517 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:19.518 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:20.027 INFO:teuthology.orchestra.run.smithi161.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T11:32:20.031 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/177 2023-08-10T11:32:20.031 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/177 2023-08-10T11:32:20.031 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:20.033 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:20.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:20.376 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-08-10T11:32:20.630 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:20.634 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:20.635 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:20.636 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:20.636 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:20.984 INFO:teuthology.orchestra.run.smithi161.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:32:20.988 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/178 2023-08-10T11:32:20.988 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/178 2023-08-10T11:32:20.988 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:20.990 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:21.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:21.276 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-08-10T11:32:21.567 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:21.571 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:21.572 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:21.572 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:21.573 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:21.940 INFO:teuthology.orchestra.run.smithi161.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:32:21.944 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/179 2023-08-10T11:32:21.945 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/179 2023-08-10T11:32:21.945 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:21.946 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:22.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:22.268 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-08-10T11:32:22.546 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:22.550 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:22.551 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:22.552 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:22.552 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:22.926 INFO:teuthology.orchestra.run.smithi161.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:32:22.930 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/180 2023-08-10T11:32:22.930 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/180 2023-08-10T11:32:22.930 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:22.932 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:23.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:23.243 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-08-10T11:32:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:23.528 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:23.872 INFO:teuthology.orchestra.run.smithi161.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:32:23.876 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/181 2023-08-10T11:32:23.877 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/181 2023-08-10T11:32:23.877 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:23.878 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:24.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:24.220 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-08-10T11:32:24.468 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:24.472 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:24.472 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:24.473 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:24.473 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:24.824 INFO:teuthology.orchestra.run.smithi161.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T11:32:24.828 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/182 2023-08-10T11:32:24.828 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/182 2023-08-10T11:32:24.828 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:24.830 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:25.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:25.174 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-08-10T11:32:25.441 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:25.445 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:25.446 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:25.447 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:26.103 INFO:teuthology.orchestra.run.smithi161.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:26.110 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/183 2023-08-10T11:32:26.110 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/183 2023-08-10T11:32:26.110 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:26.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:26.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:26.347 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-08-10T11:32:26.577 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:26.581 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:26.582 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:26.582 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:26.583 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:26.944 INFO:teuthology.orchestra.run.smithi161.stdout:generic/184 0s 2023-08-10T11:32:26.948 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/184 2023-08-10T11:32:26.949 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:26.950 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:26.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:26.980 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-08-10T11:32:27.184 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:27.188 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:27.188 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:27.189 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:27.189 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:28.005 INFO:teuthology.orchestra.run.smithi161.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:28.084 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/185 2023-08-10T11:32:28.085 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/185 2023-08-10T11:32:28.085 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:28.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:28.179 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-08-10T11:32:28.381 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:28.385 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:28.385 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:28.386 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:28.386 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:29.201 INFO:teuthology.orchestra.run.smithi161.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:29.209 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/186 2023-08-10T11:32:29.209 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/186 2023-08-10T11:32:29.209 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:29.277 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:29.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:29.315 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-08-10T11:32:29.539 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:29.543 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:29.543 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:29.544 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:29.544 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:30.436 INFO:teuthology.orchestra.run.smithi161.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:30.443 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/187 2023-08-10T11:32:30.443 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/187 2023-08-10T11:32:30.444 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:30.451 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:30.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:30.502 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-08-10T11:32:30.716 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:30.720 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:30.721 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:30.721 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:30.722 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:31.613 INFO:teuthology.orchestra.run.smithi161.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:31.625 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/188 2023-08-10T11:32:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/188 2023-08-10T11:32:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:31.628 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:31.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:31.656 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-08-10T11:32:31.859 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:31.863 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:31.863 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:31.864 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:31.864 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:32.745 INFO:teuthology.orchestra.run.smithi161.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:32.774 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/189 2023-08-10T11:32:32.775 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/189 2023-08-10T11:32:32.775 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:32.777 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:32.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:32.838 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-08-10T11:32:33.039 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:33.043 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:33.044 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:33.045 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:33.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:33.951 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/190 2023-08-10T11:32:33.952 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/190 2023-08-10T11:32:33.952 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:33.955 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:34.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:34.040 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-08-10T11:32:34.247 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:34.251 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:34.252 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:34.253 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:34.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:35.148 INFO:teuthology.orchestra.run.smithi161.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:35.153 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/191 2023-08-10T11:32:35.153 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/191 2023-08-10T11:32:35.154 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:35.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:35.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:35.226 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-08-10T11:32:35.461 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:35.465 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:35.465 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:35.466 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:35.466 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:35.800 INFO:teuthology.orchestra.run.smithi161.stdout:generic/192 [not run] atime not maintained by ceph 2023-08-10T11:32:35.804 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/192 2023-08-10T11:32:35.804 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/192 2023-08-10T11:32:35.804 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:35.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:35.834 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-08-10T11:32:36.050 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:36.054 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:36.054 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:36.055 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:36.055 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:36.899 INFO:teuthology.orchestra.run.smithi161.stdout:generic/193 0s 2023-08-10T11:32:36.904 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/193 2023-08-10T11:32:36.904 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:36.906 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:37.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:37.230 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-08-10T11:32:37.516 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:37.521 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:37.521 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:38.390 INFO:teuthology.orchestra.run.smithi161.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:38.398 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/194 2023-08-10T11:32:38.398 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/194 2023-08-10T11:32:38.398 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:38.402 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:38.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:38.493 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-08-10T11:32:38.701 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:38.705 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:38.705 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:38.706 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:38.706 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:39.578 INFO:teuthology.orchestra.run.smithi161.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:39.589 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/195 2023-08-10T11:32:39.589 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/195 2023-08-10T11:32:39.589 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:39.596 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:39.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:39.687 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-08-10T11:32:39.891 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:39.895 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:39.896 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:39.897 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:39.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:40.682 INFO:teuthology.orchestra.run.smithi161.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:40.760 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/196 2023-08-10T11:32:40.761 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/196 2023-08-10T11:32:40.761 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:40.776 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:40.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:40.827 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-08-10T11:32:41.028 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:41.032 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:41.032 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:41.033 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:41.034 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:41.919 INFO:teuthology.orchestra.run.smithi161.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:41.937 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/197 2023-08-10T11:32:41.937 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/197 2023-08-10T11:32:41.938 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:41.942 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:42.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:42.034 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-08-10T11:32:42.237 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:42.241 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:42.242 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:42.242 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:42.243 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:42.967 INFO:teuthology.orchestra.run.smithi161.stdout:generic/198 0s 2023-08-10T11:32:42.972 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/198 2023-08-10T11:32:42.972 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:42.974 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:43.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:43.317 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-08-10T11:32:43.620 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:43.624 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:43.624 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:43.625 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:43.625 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:44.498 INFO:teuthology.orchestra.run.smithi161.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:44.514 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/199 2023-08-10T11:32:44.514 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/199 2023-08-10T11:32:44.514 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:44.519 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:44.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:44.600 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-08-10T11:32:44.804 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:44.809 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:44.809 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:44.810 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:44.810 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:45.686 INFO:teuthology.orchestra.run.smithi161.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/200 2023-08-10T11:32:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/200 2023-08-10T11:32:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:45.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:45.772 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-08-10T11:32:45.976 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:45.980 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:45.980 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:45.981 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:45.981 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:46.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:32:46.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:32:46.864 INFO:teuthology.orchestra.run.smithi161.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:46.886 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/201 2023-08-10T11:32:46.887 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/201 2023-08-10T11:32:46.887 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:46.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:46.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:46.932 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-08-10T11:32:47.135 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:47.139 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:47.139 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:47.140 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:47.140 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:48.042 INFO:teuthology.orchestra.run.smithi161.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/202 2023-08-10T11:32:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/202 2023-08-10T11:32:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:48.051 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:48.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:48.077 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-08-10T11:32:48.284 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:48.288 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:48.289 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:48.290 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:48.290 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:49.172 INFO:teuthology.orchestra.run.smithi161.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:49.191 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/203 2023-08-10T11:32:49.191 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/203 2023-08-10T11:32:49.192 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:49.194 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:49.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:49.219 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-08-10T11:32:49.435 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:49.439 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:49.440 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:49.441 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:49.441 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:50.846 INFO:teuthology.orchestra.run.smithi161.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:32:50.851 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/204 2023-08-10T11:32:50.851 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/204 2023-08-10T11:32:50.852 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:50.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:50.884 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-08-10T11:32:51.098 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:51.102 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:51.103 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:51.104 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:51.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:51.863 INFO:teuthology.orchestra.run.smithi161.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:51.899 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/205 2023-08-10T11:32:51.899 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/205 2023-08-10T11:32:51.899 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:51.926 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:52.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:52.022 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-08-10T11:32:52.231 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:52.235 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:52.235 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:52.237 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:52.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:53.044 INFO:teuthology.orchestra.run.smithi161.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:32:53.051 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/206 2023-08-10T11:32:53.051 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/206 2023-08-10T11:32:53.051 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:53.054 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:53.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:53.194 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-08-10T11:32:53.395 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:32:53.399 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:32:53.400 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:32:53.401 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:32:53.401 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:generic/207 6s 2023-08-10T11:32:59.505 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/207 2023-08-10T11:32:59.506 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:32:59.507 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:32:59.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:32:59.736 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-08-10T11:33:00.067 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:33:00.071 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:33:00.071 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:33:00.072 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:33:00.072 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:33:16.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:33:16.415 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:33:46.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:33:46.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:34:16.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:34:16.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:34:46.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:34:46.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:35:16.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:35:16.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:35:47.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:35:47.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:36:17.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:36:17.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:36:20.506 INFO:teuthology.orchestra.run.smithi161.stdout:generic/208 200s 2023-08-10T11:36:20.510 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/208 2023-08-10T11:36:20.511 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:36:20.512 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:36:20.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:36:20.840 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-08-10T11:36:21.115 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:36:21.119 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:36:21.119 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:36:21.120 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:36:21.121 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:36:47.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:36:47.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:36:58.454 INFO:teuthology.orchestra.run.smithi161.stdout:generic/209 37s 2023-08-10T11:36:58.459 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/209 2023-08-10T11:36:58.459 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:36:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:36:58.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:36:58.662 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-08-10T11:36:59.066 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:36:59.070 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:36:59.070 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:36:59.071 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:36:59.071 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:36:59.502 INFO:teuthology.orchestra.run.smithi161.stdout:generic/210 0s 2023-08-10T11:36:59.507 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/210 2023-08-10T11:36:59.507 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:36:59.509 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:36:59.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:36:59.761 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-08-10T11:37:00.115 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:00.119 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:00.119 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:00.120 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:00.598 INFO:teuthology.orchestra.run.smithi161.stdout:generic/211 0s 2023-08-10T11:37:00.603 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/211 2023-08-10T11:37:00.603 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:00.605 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:00.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:00.631 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-08-10T11:37:00.833 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:00.837 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:00.838 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:00.838 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:00.839 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:01.238 INFO:teuthology.orchestra.run.smithi161.stdout:generic/212 0s 2023-08-10T11:37:01.242 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/212 2023-08-10T11:37:01.242 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:01.244 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:01.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:01.278 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-08-10T11:37:01.485 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:01.489 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:01.489 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:01.490 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:01.491 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:01.840 INFO:teuthology.orchestra.run.smithi161.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:37:01.844 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/213 2023-08-10T11:37:01.844 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/213 2023-08-10T11:37:01.844 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:01.846 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:01.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:01.868 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-08-10T11:37:02.086 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:02.090 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:02.090 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:02.091 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:02.091 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:02.422 INFO:teuthology.orchestra.run.smithi161.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:37:02.426 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/214 2023-08-10T11:37:02.426 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/214 2023-08-10T11:37:02.427 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:02.428 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:02.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:02.451 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-08-10T11:37:02.655 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:02.659 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:02.660 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:02.661 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:02.661 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:05.065 INFO:teuthology.orchestra.run.smithi161.stdout:generic/215 3s 2023-08-10T11:37:05.084 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/215 2023-08-10T11:37:05.084 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:05.086 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:05.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:05.130 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-08-10T11:37:05.353 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:05.357 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:05.357 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:05.358 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:05.358 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:06.184 INFO:teuthology.orchestra.run.smithi161.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:06.217 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/216 2023-08-10T11:37:06.218 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/216 2023-08-10T11:37:06.218 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:06.244 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:06.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:06.278 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-08-10T11:37:06.479 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:06.483 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:06.483 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:06.484 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:06.484 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:07.314 INFO:teuthology.orchestra.run.smithi161.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:07.320 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/217 2023-08-10T11:37:07.320 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/217 2023-08-10T11:37:07.320 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:07.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:07.431 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-08-10T11:37:07.637 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:07.641 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:07.641 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:07.642 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:07.642 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:08.423 INFO:teuthology.orchestra.run.smithi161.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:08.506 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/218 2023-08-10T11:37:08.506 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/218 2023-08-10T11:37:08.506 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:08.514 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:08.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:08.581 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-08-10T11:37:08.798 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:08.802 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:08.802 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:08.803 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:08.803 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:09.129 INFO:teuthology.orchestra.run.smithi161.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:09.132 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/219 2023-08-10T11:37:09.133 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/219 2023-08-10T11:37:09.133 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:09.135 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:09.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:09.164 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-08-10T11:37:09.372 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:09.376 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:09.376 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:09.377 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:09.377 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:10.077 INFO:teuthology.orchestra.run.smithi161.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/220 2023-08-10T11:37:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/220 2023-08-10T11:37:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:10.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:10.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:10.325 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-08-10T11:37:10.531 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:10.536 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:10.536 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:10.537 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:10.537 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:11.909 INFO:teuthology.orchestra.run.smithi161.stdout:generic/221 1s 2023-08-10T11:37:11.914 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/221 2023-08-10T11:37:11.915 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:11.917 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:11.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:11.950 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-08-10T11:37:12.155 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:12.159 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:12.160 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:12.161 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:12.161 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:12.963 INFO:teuthology.orchestra.run.smithi161.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:13.006 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/222 2023-08-10T11:37:13.006 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/222 2023-08-10T11:37:13.007 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:13.033 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:13.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:13.113 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-08-10T11:37:13.315 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:13.319 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:13.319 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:13.320 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:13.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:13.668 INFO:teuthology.orchestra.run.smithi161.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:37:13.672 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/223 2023-08-10T11:37:13.672 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/223 2023-08-10T11:37:13.672 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:13.674 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:13.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:13.712 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-08-10T11:37:13.915 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:13.919 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:13.919 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:13.920 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:13.920 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:14.249 INFO:teuthology.orchestra.run.smithi161.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:37:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/224 2023-08-10T11:37:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/224 2023-08-10T11:37:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:14.255 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:14.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:14.279 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-08-10T11:37:14.503 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:14.507 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:14.508 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:14.508 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:14.509 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:14.901 INFO:teuthology.orchestra.run.smithi161.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T11:37:14.902 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/225 2023-08-10T11:37:14.902 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/225 2023-08-10T11:37:14.902 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:14.903 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:15.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:15.247 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-08-10T11:37:15.476 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:15.480 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:15.481 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:15.482 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:15.482 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:15.856 INFO:teuthology.orchestra.run.smithi161.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:37:15.860 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/226 2023-08-10T11:37:15.860 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/226 2023-08-10T11:37:15.860 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:15.862 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:15.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:15.900 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-08-10T11:37:16.132 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:16.136 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:16.136 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:16.137 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:16.137 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:16.996 INFO:teuthology.orchestra.run.smithi161.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:17.004 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/227 2023-08-10T11:37:17.005 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/227 2023-08-10T11:37:17.005 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:17.007 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:17.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:17.069 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-08-10T11:37:17.300 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:17.304 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:17.305 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:17.306 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:17.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:17.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:37:17.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:37:17.677 INFO:teuthology.orchestra.run.smithi161.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:37:17.681 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/228 2023-08-10T11:37:17.681 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/228 2023-08-10T11:37:17.682 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:17.683 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:17.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:17.708 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-08-10T11:37:17.958 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:17.962 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:17.963 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:17.964 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:17.964 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:18.839 INFO:teuthology.orchestra.run.smithi161.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:18.864 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/229 2023-08-10T11:37:18.864 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/229 2023-08-10T11:37:18.864 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:18.866 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:18.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:18.914 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-08-10T11:37:19.115 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:19.119 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:19.119 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:19.120 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:19.120 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:19.451 INFO:teuthology.orchestra.run.smithi161.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:19.455 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/230 2023-08-10T11:37:19.456 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/230 2023-08-10T11:37:19.456 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:19.457 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:19.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:19.489 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-08-10T11:37:19.702 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:19.706 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:19.707 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:19.707 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:19.707 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:20.045 INFO:teuthology.orchestra.run.smithi161.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:20.048 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/231 2023-08-10T11:37:20.049 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/231 2023-08-10T11:37:20.049 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:20.051 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:20.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:20.083 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-08-10T11:37:20.283 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:20.287 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:20.288 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:20.288 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:20.289 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:20.619 INFO:teuthology.orchestra.run.smithi161.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:20.623 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/232 2023-08-10T11:37:20.623 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/232 2023-08-10T11:37:20.624 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:20.625 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:20.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:20.647 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-08-10T11:37:20.849 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:20.853 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:20.853 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:20.854 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:20.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:21.178 INFO:teuthology.orchestra.run.smithi161.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:21.182 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/233 2023-08-10T11:37:21.182 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/233 2023-08-10T11:37:21.182 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:21.184 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:21.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:21.203 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-08-10T11:37:21.416 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:21.421 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:21.421 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:21.422 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:21.422 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:21.744 INFO:teuthology.orchestra.run.smithi161.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:21.748 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/234 2023-08-10T11:37:21.748 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/234 2023-08-10T11:37:21.748 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:21.750 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:21.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:21.776 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-08-10T11:37:21.989 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:21.993 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:21.994 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:21.995 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:21.995 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:22.325 INFO:teuthology.orchestra.run.smithi161.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:37:22.329 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/235 2023-08-10T11:37:22.329 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/235 2023-08-10T11:37:22.329 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:22.331 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:22.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:22.358 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-08-10T11:37:22.562 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:22.566 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:22.567 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:22.568 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:22.568 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:23.951 INFO:teuthology.orchestra.run.smithi161.stdout:generic/236 1s 2023-08-10T11:37:23.957 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/236 2023-08-10T11:37:23.957 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:23.959 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:24.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:24.050 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-08-10T11:37:24.550 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:24.554 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:24.555 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:24.555 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:24.556 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:24.960 INFO:teuthology.orchestra.run.smithi161.stdout:generic/237 0s 2023-08-10T11:37:24.965 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/237 2023-08-10T11:37:24.965 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:24.967 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:25.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:25.293 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-08-10T11:37:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:25.564 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:25.565 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:25.565 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:25.566 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:26.415 INFO:teuthology.orchestra.run.smithi161.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:37:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/238 2023-08-10T11:37:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/238 2023-08-10T11:37:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:37:26.458 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:26.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:37:26.487 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-08-10T11:37:26.718 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:37:26.722 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:37:26.722 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:37:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:37:26.723 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:37:47.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:37:47.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:38:17.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:38:17.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:38:47.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:38:47.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:39:16.247 INFO:teuthology.orchestra.run.smithi161.stdout:generic/239 110s 2023-08-10T11:39:16.252 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/239 2023-08-10T11:39:16.252 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:39:16.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:39:16.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:39:16.520 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-08-10T11:39:16.837 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:39:16.841 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:39:16.842 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:39:16.842 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:39:16.843 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:39:17.523 INFO:teuthology.orchestra.run.smithi161.stdout:generic/240 0s 2023-08-10T11:39:17.528 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/240 2023-08-10T11:39:17.528 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:39:17.530 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:39:17.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:39:17.883 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-08-10T11:39:18.163 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:39:18.166 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:39:18.167 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:39:18.168 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:39:18.168 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:39:18.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:39:18.338 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:39:18.374 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T11:39:18.373+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145228) UID: 0 2023-08-10T11:39:18.375 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T11:39:18.373+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145228) UID: 0 2023-08-10T11:39:18.375 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T11:39:18.373+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145228) UID: 0 2023-08-10T11:39:18.376 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T11:39:18.373+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145228) UID: 0 2023-08-10T11:39:18.378 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:39:18.377+0000 7f6ff6f5a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 342853) UID: 0 2023-08-10T11:39:18.379 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T11:39:18.377+0000 7fbfda245700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 342853) UID: 0 2023-08-10T11:39:18.379 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:39:18.377+0000 7f91d129e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 342853) UID: 0 2023-08-10T11:39:18.379 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:39:18.378+0000 7fa60693b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 342853) UID: 0 2023-08-10T11:40:31.885 INFO:teuthology.orchestra.run.smithi161.stdout:generic/241 73s 2023-08-10T11:40:31.889 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/241 2023-08-10T11:40:31.890 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:31.891 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:34.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:34.828 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-08-10T11:40:35.075 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:35.079 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:35.079 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:35.080 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:35.080 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:36.857 INFO:teuthology.orchestra.run.smithi161.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:40:36.941 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/242 2023-08-10T11:40:36.942 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/242 2023-08-10T11:40:36.942 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:36.952 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:37.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:37.142 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-08-10T11:40:37.611 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:37.616 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:37.616 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:37.617 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:37.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:38.296 INFO:teuthology.orchestra.run.smithi161.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:40:38.302 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/243 2023-08-10T11:40:38.302 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/243 2023-08-10T11:40:38.302 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:38.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:38.610 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-08-10T11:40:38.830 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:38.834 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:38.835 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:38.836 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:38.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:39.177 INFO:teuthology.orchestra.run.smithi161.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:40:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/244 2023-08-10T11:40:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/244 2023-08-10T11:40:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:39.183 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:39.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:39.206 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-08-10T11:40:39.409 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:39.414 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:39.415 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:39.415 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:39.800 INFO:teuthology.orchestra.run.smithi161.stdout:generic/245 0s 2023-08-10T11:40:39.805 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/245 2023-08-10T11:40:39.805 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:39.807 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:40.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:40.031 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-08-10T11:40:40.424 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:40.427 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:40.428 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:40.429 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:40.429 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:40.786 INFO:teuthology.orchestra.run.smithi161.stdout:generic/246 0s 2023-08-10T11:40:40.791 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/246 2023-08-10T11:40:40.791 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:40.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:41.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:41.182 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-08-10T11:40:41.431 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:41.435 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:41.435 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:41.436 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:41.436 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:generic/247 6s 2023-08-10T11:40:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/247 2023-08-10T11:40:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:47.814 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:47.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:47.822 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-08-10T11:40:48.030 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:48.034 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:48.035 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:48.036 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:48.036 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:48.412 INFO:teuthology.orchestra.run.smithi161.stdout:generic/248 0s 2023-08-10T11:40:48.416 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/248 2023-08-10T11:40:48.417 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:48.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:48.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:48.462 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-08-10T11:40:48.665 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:48.669 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:48.669 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:48.670 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:48.670 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:49.247 INFO:teuthology.orchestra.run.smithi161.stdout:generic/249 1s 2023-08-10T11:40:49.251 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/249 2023-08-10T11:40:49.252 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:49.253 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:49.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:49.665 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-08-10T11:40:49.897 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:49.901 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:49.902 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:49.903 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:49.903 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:50.256 INFO:teuthology.orchestra.run.smithi161.stdout:generic/250 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:40:50.260 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/250 2023-08-10T11:40:50.261 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/250 2023-08-10T11:40:50.261 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:50.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:50.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:50.317 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-08-10T11:40:50.537 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:50.541 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:50.541 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:50.542 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:50.542 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:51.055 INFO:teuthology.orchestra.run.smithi161.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:51.079 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/251 2023-08-10T11:40:51.079 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/251 2023-08-10T11:40:51.080 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:51.081 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:51.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:51.099 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-08-10T11:40:51.320 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:51.324 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:51.324 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:51.325 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:51.693 INFO:teuthology.orchestra.run.smithi161.stdout:generic/252 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:40:51.697 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/252 2023-08-10T11:40:51.697 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/252 2023-08-10T11:40:51.697 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:51.699 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:51.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:51.725 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-08-10T11:40:51.947 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:51.952 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:51.952 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:51.954 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:51.954 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:52.874 INFO:teuthology.orchestra.run.smithi161.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:40:52.913 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/253 2023-08-10T11:40:52.914 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/253 2023-08-10T11:40:52.914 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:52.916 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:52.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:52.950 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-08-10T11:40:53.173 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:53.177 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:53.178 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:53.178 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:53.179 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:53.956 INFO:teuthology.orchestra.run.smithi161.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:40:53.985 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/254 2023-08-10T11:40:53.985 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/254 2023-08-10T11:40:53.986 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:53.994 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:54.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:54.150 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-08-10T11:40:54.383 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:54.387 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:54.388 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:54.388 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:54.389 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:54.819 INFO:teuthology.orchestra.run.smithi161.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:40:54.823 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/255 2023-08-10T11:40:54.823 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/255 2023-08-10T11:40:54.823 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:54.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:54.962 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-08-10T11:40:55.476 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:55.480 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:55.480 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:55.481 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:55.481 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:56.023 INFO:teuthology.orchestra.run.smithi161.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:40:56.027 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/256 2023-08-10T11:40:56.027 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/256 2023-08-10T11:40:56.027 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:56.029 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:56.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:56.065 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-08-10T11:40:56.289 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:56.293 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:56.294 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:56.294 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:56.295 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:57.192 INFO:teuthology.orchestra.run.smithi161.stdout:generic/257 1s 2023-08-10T11:40:57.197 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/257 2023-08-10T11:40:57.197 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:57.199 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:57.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:57.605 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-08-10T11:40:57.921 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:57.924 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:57.925 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:57.926 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:57.926 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:58.255 INFO:teuthology.orchestra.run.smithi161.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-08-10T11:40:58.259 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/258 2023-08-10T11:40:58.259 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/258 2023-08-10T11:40:58.259 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:58.261 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:58.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:58.294 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-08-10T11:40:58.643 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:58.648 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:58.648 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:59.522 INFO:teuthology.orchestra.run.smithi161.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:40:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/259 2023-08-10T11:40:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/259 2023-08-10T11:40:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:40:59.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:40:59.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:40:59.606 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-08-10T11:40:59.820 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:40:59.823 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:40:59.824 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:40:59.825 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:40:59.825 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:00.305 INFO:teuthology.orchestra.run.smithi161.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/260 2023-08-10T11:41:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/260 2023-08-10T11:41:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:00.337 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:00.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:00.362 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-08-10T11:41:00.566 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:00.570 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:00.571 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:00.571 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:00.572 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:01.364 INFO:teuthology.orchestra.run.smithi161.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:01.371 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/261 2023-08-10T11:41:01.372 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/261 2023-08-10T11:41:01.372 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:01.375 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:01.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:01.550 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-08-10T11:41:01.753 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:01.757 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:01.758 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:01.759 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:01.759 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:02.627 INFO:teuthology.orchestra.run.smithi161.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:02.662 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/262 2023-08-10T11:41:02.662 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/262 2023-08-10T11:41:02.662 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:02.670 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:02.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:02.736 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-08-10T11:41:02.952 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:02.957 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:02.957 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:02.958 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:47.899 INFO:teuthology.orchestra.run.smithi161.stdout:generic/263 44s 2023-08-10T11:41:47.904 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/263 2023-08-10T11:41:47.904 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:47.906 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:48.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:48.268 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-08-10T11:41:48.505 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:48.509 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:48.510 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:48.510 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:48.511 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:49.408 INFO:teuthology.orchestra.run.smithi161.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:49.424 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/264 2023-08-10T11:41:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/264 2023-08-10T11:41:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:49.429 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:49.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:49.458 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-08-10T11:41:49.661 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:49.665 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:49.666 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:49.666 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:49.667 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:50.615 INFO:teuthology.orchestra.run.smithi161.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:50.620 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/265 2023-08-10T11:41:50.621 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/265 2023-08-10T11:41:50.621 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:50.623 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:50.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:50.645 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-08-10T11:41:50.859 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:50.863 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:50.864 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:50.865 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:51.711 INFO:teuthology.orchestra.run.smithi161.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:51.720 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/266 2023-08-10T11:41:51.720 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/266 2023-08-10T11:41:51.720 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:51.726 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:51.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:51.798 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-08-10T11:41:52.039 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:52.044 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:52.044 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:52.045 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:52.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:52.947 INFO:teuthology.orchestra.run.smithi161.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:52.965 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/267 2023-08-10T11:41:52.965 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/267 2023-08-10T11:41:52.965 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:52.967 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:52.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:52.994 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-08-10T11:41:53.210 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:53.214 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:53.215 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:53.215 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:54.127 INFO:teuthology.orchestra.run.smithi161.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:54.132 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/268 2023-08-10T11:41:54.132 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/268 2023-08-10T11:41:54.132 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:54.135 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:54.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:54.168 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-08-10T11:41:54.377 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:54.381 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:54.381 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:54.382 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:54.382 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:54.713 INFO:teuthology.orchestra.run.smithi161.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:41:54.717 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/269 2023-08-10T11:41:54.717 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/269 2023-08-10T11:41:54.717 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:54.719 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:54.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:54.751 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-08-10T11:41:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:54.960 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:54.960 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:54.961 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:54.961 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:55.291 INFO:teuthology.orchestra.run.smithi161.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:41:55.294 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/270 2023-08-10T11:41:55.294 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/270 2023-08-10T11:41:55.295 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:55.296 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:55.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:55.318 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-08-10T11:41:55.530 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:55.535 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:55.535 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:55.536 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:55.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:56.395 INFO:teuthology.orchestra.run.smithi161.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:56.403 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/271 2023-08-10T11:41:56.404 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/271 2023-08-10T11:41:56.404 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:56.413 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:56.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:56.457 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-08-10T11:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:57.474 INFO:teuthology.orchestra.run.smithi161.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:41:57.498 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/272 2023-08-10T11:41:57.498 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/272 2023-08-10T11:41:57.499 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:57.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:57.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:57.619 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-08-10T11:41:57.821 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:57.824 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:57.825 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:57.826 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:57.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:58.153 INFO:teuthology.orchestra.run.smithi161.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:41:58.157 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/273 2023-08-10T11:41:58.157 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/273 2023-08-10T11:41:58.157 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:58.159 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:58.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:58.183 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-08-10T11:41:58.387 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:58.391 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:58.392 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:58.392 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:58.727 INFO:teuthology.orchestra.run.smithi161.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-10T11:41:58.731 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/274 2023-08-10T11:41:58.732 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/274 2023-08-10T11:41:58.732 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:58.733 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:58.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:58.768 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-08-10T11:41:58.976 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:58.980 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:58.981 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:58.981 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:58.981 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:41:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/275 2023-08-10T11:41:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/275 2023-08-10T11:41:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:41:59.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:41:59.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:41:59.330 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-08-10T11:41:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:41:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:41:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:41:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:41:59.540 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:00.402 INFO:teuthology.orchestra.run.smithi161.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:00.431 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/276 2023-08-10T11:42:00.431 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/276 2023-08-10T11:42:00.431 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:00.437 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:00.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:00.463 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-08-10T11:42:00.664 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:00.668 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:00.669 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:00.670 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:00.670 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:01.017 INFO:teuthology.orchestra.run.smithi161.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-08-10T11:42:01.021 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/277 2023-08-10T11:42:01.021 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/277 2023-08-10T11:42:01.021 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:01.023 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:01.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:01.067 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-08-10T11:42:01.272 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:01.276 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:01.277 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:01.277 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:01.277 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:02.137 INFO:teuthology.orchestra.run.smithi161.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:02.202 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/278 2023-08-10T11:42:02.202 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/278 2023-08-10T11:42:02.203 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:02.208 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:02.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:02.234 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-08-10T11:42:02.434 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:02.517 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:02.517 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:02.518 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:02.518 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:03.324 INFO:teuthology.orchestra.run.smithi161.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:03.338 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/279 2023-08-10T11:42:03.338 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/279 2023-08-10T11:42:03.338 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:03.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:03.382 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-08-10T11:42:03.583 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:03.587 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:03.588 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:03.589 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:03.589 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:03.940 INFO:teuthology.orchestra.run.smithi161.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:42:03.944 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/280 2023-08-10T11:42:03.944 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/280 2023-08-10T11:42:03.944 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:03.946 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:03.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:03.974 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-08-10T11:42:04.185 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:04.189 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:04.189 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:04.190 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:05.049 INFO:teuthology.orchestra.run.smithi161.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:05.057 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/281 2023-08-10T11:42:05.057 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/281 2023-08-10T11:42:05.058 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:05.081 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:05.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:05.117 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-08-10T11:42:05.321 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:05.325 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:05.325 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:05.326 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:05.326 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:06.202 INFO:teuthology.orchestra.run.smithi161.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:06.210 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/282 2023-08-10T11:42:06.210 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/282 2023-08-10T11:42:06.210 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:06.212 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:06.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:06.265 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-08-10T11:42:06.481 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:06.485 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:06.485 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:06.486 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:06.486 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:07.413 INFO:teuthology.orchestra.run.smithi161.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:07.426 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/283 2023-08-10T11:42:07.426 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/283 2023-08-10T11:42:07.426 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:07.433 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:07.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:07.465 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-08-10T11:42:07.669 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:07.673 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:07.674 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:07.674 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:07.674 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:08.416 INFO:teuthology.orchestra.run.smithi161.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:08.558 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/284 2023-08-10T11:42:08.558 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/284 2023-08-10T11:42:08.558 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:08.566 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:08.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:08.625 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-08-10T11:42:08.830 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:08.834 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:08.835 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:08.836 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:08.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:09.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:42:09.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:42:09.489 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T11:42:09.488+0000 7f6ff6f5a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366907) UID: 0 2023-08-10T11:42:09.489 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T11:42:09.488+0000 7fbfda245700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366907) UID: 0 2023-08-10T11:42:09.490 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T11:42:09.488+0000 7f91d129e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366907) UID: 0 2023-08-10T11:42:09.490 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T11:42:09.488+0000 7fa60693b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366907) UID: 0 2023-08-10T11:42:09.659 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T11:42:09.658+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 146023) UID: 0 2023-08-10T11:42:09.659 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T11:42:09.658+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 146023) UID: 0 2023-08-10T11:42:10.077 INFO:teuthology.orchestra.run.smithi161.stdout:generic/285 1s 2023-08-10T11:42:10.081 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/285 2023-08-10T11:42:10.081 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:10.083 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:10.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:10.672 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-08-10T11:42:11.043 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:11.047 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:11.047 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:11.048 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:11.470 INFO:teuthology.orchestra.run.smithi161.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:42:11.475 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/286 2023-08-10T11:42:11.476 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/286 2023-08-10T11:42:11.476 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:11.478 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:11.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:11.525 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-08-10T11:42:11.949 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:11.959 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:11.959 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:11.960 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:11.960 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:12.999 INFO:teuthology.orchestra.run.smithi161.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:13.067 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/287 2023-08-10T11:42:13.067 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/287 2023-08-10T11:42:13.067 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:13.085 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:13.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:13.200 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-08-10T11:42:13.595 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:13.600 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:13.600 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:13.601 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:13.602 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:14.368 INFO:teuthology.orchestra.run.smithi161.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:14.399 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/288 2023-08-10T11:42:14.399 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/288 2023-08-10T11:42:14.400 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:14.401 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:14.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:14.439 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-08-10T11:42:14.833 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:14.842 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:14.843 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:14.844 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:14.844 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:15.843 INFO:teuthology.orchestra.run.smithi161.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:15.850 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/289 2023-08-10T11:42:15.850 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/289 2023-08-10T11:42:15.850 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:15.859 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:16.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:16.105 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-08-10T11:42:16.496 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:16.505 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:16.505 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:16.506 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:17.527 INFO:teuthology.orchestra.run.smithi161.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:17.667 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/290 2023-08-10T11:42:17.667 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/290 2023-08-10T11:42:17.667 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:17.734 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:17.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:17.763 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-08-10T11:42:17.979 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:17.983 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:17.983 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:17.984 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:17.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:18.860 INFO:teuthology.orchestra.run.smithi161.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:18.866 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/291 2023-08-10T11:42:18.866 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/291 2023-08-10T11:42:18.867 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:18.869 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:18.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:18.958 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-08-10T11:42:19.178 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:19.181 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:19.182 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:19.183 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:19.183 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:20.068 INFO:teuthology.orchestra.run.smithi161.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:20.133 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/292 2023-08-10T11:42:20.134 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/292 2023-08-10T11:42:20.134 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:20.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:20.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:20.188 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-08-10T11:42:20.404 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:20.408 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:20.408 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:20.409 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:20.409 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:21.354 INFO:teuthology.orchestra.run.smithi161.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:21.363 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/293 2023-08-10T11:42:21.364 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/293 2023-08-10T11:42:21.364 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:21.367 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:21.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:21.400 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-08-10T11:42:21.605 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:21.609 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:21.609 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:21.610 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:21.610 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:22.579 INFO:teuthology.orchestra.run.smithi161.stdout:generic/294 1s 2023-08-10T11:42:22.605 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/294 2023-08-10T11:42:22.606 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:22.608 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:22.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:22.627 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-08-10T11:42:22.859 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:22.862 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:22.863 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:22.863 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:22.864 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/295 2023-08-10T11:42:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/295 2023-08-10T11:42:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:23.622 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:23.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:23.814 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-08-10T11:42:24.028 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:24.032 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:24.032 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:24.033 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:24.033 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:24.933 INFO:teuthology.orchestra.run.smithi161.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:25.022 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/296 2023-08-10T11:42:25.023 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/296 2023-08-10T11:42:25.023 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:25.025 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:25.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:25.056 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-08-10T11:42:25.278 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:25.282 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:25.283 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:25.283 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:25.283 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:26.159 INFO:teuthology.orchestra.run.smithi161.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:26.193 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/297 2023-08-10T11:42:26.194 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/297 2023-08-10T11:42:26.194 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:26.209 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:26.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:26.247 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-08-10T11:42:26.449 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:26.453 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:26.453 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:26.454 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:26.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:27.361 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/298 2023-08-10T11:42:27.361 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/298 2023-08-10T11:42:27.361 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:27.375 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:27.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:27.419 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-08-10T11:42:27.622 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:27.626 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:27.626 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:27.627 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:27.627 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:28.024 INFO:teuthology.orchestra.run.smithi161.stdout:generic/299 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:42:28.027 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/299 2023-08-10T11:42:28.028 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/299 2023-08-10T11:42:28.028 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:28.030 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:28.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:28.063 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-08-10T11:42:28.292 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:28.296 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:28.297 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:28.298 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:28.298 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:28.676 INFO:teuthology.orchestra.run.smithi161.stdout:generic/300 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:42:28.680 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/300 2023-08-10T11:42:28.680 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/300 2023-08-10T11:42:28.680 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:28.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:28.713 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-08-10T11:42:28.932 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:28.936 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:28.937 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:28.938 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:28.938 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:29.876 INFO:teuthology.orchestra.run.smithi161.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:29.883 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/301 2023-08-10T11:42:29.883 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/301 2023-08-10T11:42:29.883 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:29.894 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:29.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:29.920 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-08-10T11:42:30.150 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:30.155 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:30.155 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:30.156 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:30.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:31.038 INFO:teuthology.orchestra.run.smithi161.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:31.092 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/302 2023-08-10T11:42:31.093 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/302 2023-08-10T11:42:31.093 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:31.122 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:31.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:31.154 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-08-10T11:42:31.389 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:31.392 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:31.393 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:31.394 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:31.394 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:31.779 INFO:teuthology.orchestra.run.smithi161.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:42:31.783 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/303 2023-08-10T11:42:31.784 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/303 2023-08-10T11:42:31.784 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:31.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:32.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:32.015 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-08-10T11:42:32.407 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:32.411 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:32.411 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:32.412 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:32.412 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:32.775 INFO:teuthology.orchestra.run.smithi161.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T11:42:32.778 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/304 2023-08-10T11:42:32.778 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/304 2023-08-10T11:42:32.779 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:32.780 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:33.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:33.080 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-08-10T11:42:33.401 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:33.427 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:34.189 INFO:teuthology.orchestra.run.smithi161.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:42:34.273 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/305 2023-08-10T11:42:34.273 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/305 2023-08-10T11:42:34.274 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:34.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:34.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:34.357 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-08-10T11:42:34.575 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:34.579 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:34.579 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:34.580 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:34.580 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:35.639 INFO:teuthology.orchestra.run.smithi161.stdout:generic/306 1s 2023-08-10T11:42:35.644 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/306 2023-08-10T11:42:35.644 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:35.646 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:36.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:36.034 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-08-10T11:42:36.288 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:36.291 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:36.292 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:36.293 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:36.293 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:38.091 INFO:teuthology.orchestra.run.smithi161.stdout:generic/307 2s 2023-08-10T11:42:38.095 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/307 2023-08-10T11:42:38.095 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:38.097 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:38.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:38.106 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-08-10T11:42:38.337 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:38.341 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:38.341 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:38.704 INFO:teuthology.orchestra.run.smithi161.stdout:generic/308 0s 2023-08-10T11:42:38.709 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/308 2023-08-10T11:42:38.710 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:38.711 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:38.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:38.750 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-08-10T11:42:38.961 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:38.965 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:38.965 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:38.966 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:38.966 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:40.354 INFO:teuthology.orchestra.run.smithi161.stdout:generic/309 1s 2023-08-10T11:42:40.427 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/309 2023-08-10T11:42:40.428 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:42:40.429 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:42:40.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:42:40.784 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-08-10T11:42:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:42:41.079 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:42:41.079 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:42:41.080 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:42:41.080 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:43:58.381 INFO:teuthology.orchestra.run.smithi161.stdout:generic/310 77s 2023-08-10T11:43:58.386 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/310 2023-08-10T11:43:58.386 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:43:58.388 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:43:58.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:43:58.791 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-08-10T11:43:59.179 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:43:59.183 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:43:59.183 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:43:59.184 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:43:59.184 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:43:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:generic/311 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:43:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/311 2023-08-10T11:43:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/311 2023-08-10T11:43:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:43:59.572 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:43:59.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:43:59.605 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-08-10T11:43:59.827 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:43:59.831 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:43:59.832 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:43:59.833 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:43:59.833 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:00.182 INFO:teuthology.orchestra.run.smithi161.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:44:00.186 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/312 2023-08-10T11:44:00.187 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/312 2023-08-10T11:44:00.187 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:00.189 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:00.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:00.221 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-08-10T11:44:00.444 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:00.447 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:00.448 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:00.448 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:00.449 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:04.848 INFO:teuthology.orchestra.run.smithi161.stdout:generic/313 4s 2023-08-10T11:44:04.853 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/313 2023-08-10T11:44:04.853 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:04.855 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:04.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:04.893 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-08-10T11:44:05.096 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:05.100 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:05.100 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:05.101 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:05.101 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:05.575 INFO:teuthology.orchestra.run.smithi161.stdout:generic/314 0s 2023-08-10T11:44:05.580 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/314 2023-08-10T11:44:05.580 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:05.582 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:05.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:05.614 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-08-10T11:44:05.820 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:05.824 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:05.824 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:05.825 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:05.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:06.171 INFO:teuthology.orchestra.run.smithi161.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-10T11:44:06.174 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/315 2023-08-10T11:44:06.175 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/315 2023-08-10T11:44:06.175 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:06.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:06.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:06.212 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-08-10T11:44:06.415 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:06.419 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:06.420 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:06.421 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:06.421 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:06.877 INFO:teuthology.orchestra.run.smithi161.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T11:44:06.881 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/316 2023-08-10T11:44:06.881 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/316 2023-08-10T11:44:06.881 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:06.883 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:07.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:07.161 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-08-10T11:44:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:07.485 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:07.485 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:07.486 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:07.486 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:08.822 INFO:teuthology.orchestra.run.smithi161.stdout:generic/317 1s 2023-08-10T11:44:08.827 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/317 2023-08-10T11:44:08.827 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:08.829 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:08.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:08.838 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-08-10T11:44:09.046 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:09.050 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:09.050 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:09.051 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:09.052 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:09.867 INFO:teuthology.orchestra.run.smithi161.stdout:generic/318 0s 2023-08-10T11:44:09.872 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/318 2023-08-10T11:44:09.872 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:09.874 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:09.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:09.883 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-08-10T11:44:10.086 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:10.090 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:10.091 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:10.092 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:10.092 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:10.667 INFO:teuthology.orchestra.run.smithi161.stdout:generic/319 0s 2023-08-10T11:44:10.672 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/319 2023-08-10T11:44:10.672 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:10.674 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:10.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:10.683 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-08-10T11:44:10.885 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:10.889 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:10.890 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:10.891 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:10.891 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:11.213 INFO:teuthology.orchestra.run.smithi161.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:44:11.217 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/320 2023-08-10T11:44:11.217 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/320 2023-08-10T11:44:11.217 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:11.219 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:11.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:11.248 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-08-10T11:44:11.460 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:11.464 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:11.465 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:11.466 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:11.466 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:11.798 INFO:teuthology.orchestra.run.smithi161.stdout:generic/321 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:44:11.802 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/321 2023-08-10T11:44:11.802 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/321 2023-08-10T11:44:11.802 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:11.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:11.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:11.825 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-08-10T11:44:12.034 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:12.037 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:12.038 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:12.039 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:12.039 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:12.386 INFO:teuthology.orchestra.run.smithi161.stdout:generic/322 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:44:12.390 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/322 2023-08-10T11:44:12.390 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/322 2023-08-10T11:44:12.390 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:44:12.392 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:44:12.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:44:12.412 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-08-10T11:44:12.613 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:44:12.617 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:44:12.617 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:44:12.618 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:44:12.619 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:45:27.401 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:45:27.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:45:57.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:45:57.482 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:46:13.401 INFO:teuthology.orchestra.run.smithi161.stdout:generic/323 121s 2023-08-10T11:46:13.405 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/323 2023-08-10T11:46:13.406 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:13.407 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:13.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:13.623 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-08-10T11:46:13.994 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:13.998 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:13.998 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:13.999 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:13.999 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:14.321 INFO:teuthology.orchestra.run.smithi161.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-08-10T11:46:14.325 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/324 2023-08-10T11:46:14.325 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/324 2023-08-10T11:46:14.325 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:14.327 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:14.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:14.355 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-08-10T11:46:14.557 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:14.561 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:14.562 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:14.563 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:14.563 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:14.919 INFO:teuthology.orchestra.run.smithi161.stdout:generic/325 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:46:14.923 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/325 2023-08-10T11:46:14.923 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/325 2023-08-10T11:46:14.923 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:14.925 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:14.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:14.949 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-08-10T11:46:15.181 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:15.185 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:15.186 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:15.187 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:15.187 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:15.920 INFO:teuthology.orchestra.run.smithi161.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:15.964 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/326 2023-08-10T11:46:15.964 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/326 2023-08-10T11:46:15.964 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:16.032 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:16.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:16.083 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-08-10T11:46:16.313 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:16.318 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:16.319 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:16.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:16.991 INFO:teuthology.orchestra.run.smithi161.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:16.997 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/327 2023-08-10T11:46:16.997 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/327 2023-08-10T11:46:16.997 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:17.009 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:17.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:17.218 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-08-10T11:46:17.449 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:17.453 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:17.454 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:17.455 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:17.455 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:18.271 INFO:teuthology.orchestra.run.smithi161.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:18.393 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/328 2023-08-10T11:46:18.394 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/328 2023-08-10T11:46:18.394 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:18.397 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:18.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:18.426 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-08-10T11:46:18.637 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:18.641 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:18.642 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:18.643 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:18.643 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:19.550 INFO:teuthology.orchestra.run.smithi161.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:19.583 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/329 2023-08-10T11:46:19.583 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/329 2023-08-10T11:46:19.583 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:19.585 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:19.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:19.614 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-08-10T11:46:19.822 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:19.826 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:19.826 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:19.827 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:19.827 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:20.759 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/330 2023-08-10T11:46:20.759 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/330 2023-08-10T11:46:20.759 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:20.763 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:20.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:20.791 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-08-10T11:46:20.999 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:21.003 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:21.004 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:21.005 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:21.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:21.897 INFO:teuthology.orchestra.run.smithi161.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/331 2023-08-10T11:46:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/331 2023-08-10T11:46:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:21.942 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:21.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:21.981 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-08-10T11:46:22.214 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:22.218 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:22.219 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:22.219 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:22.220 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:23.076 INFO:teuthology.orchestra.run.smithi161.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:23.090 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/332 2023-08-10T11:46:23.090 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/332 2023-08-10T11:46:23.090 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:23.094 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:23.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:23.156 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-08-10T11:46:23.373 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:23.377 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:23.377 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:23.378 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:23.379 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:24.265 INFO:teuthology.orchestra.run.smithi161.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:24.273 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/333 2023-08-10T11:46:24.273 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/333 2023-08-10T11:46:24.273 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:24.278 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:24.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:24.306 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-08-10T11:46:24.516 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:24.519 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:24.520 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:24.521 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:24.521 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:25.380 INFO:teuthology.orchestra.run.smithi161.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:46:25.406 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/334 2023-08-10T11:46:25.406 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/334 2023-08-10T11:46:25.406 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:25.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:25.444 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-08-10T11:46:25.662 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:25.666 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:25.667 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:25.668 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:25.668 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:26.013 INFO:teuthology.orchestra.run.smithi161.stdout:generic/335 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:46:26.017 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/335 2023-08-10T11:46:26.017 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/335 2023-08-10T11:46:26.018 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:26.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:26.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:26.044 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-08-10T11:46:26.249 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:26.253 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:26.253 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:26.254 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:26.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:26.618 INFO:teuthology.orchestra.run.smithi161.stdout:generic/336 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:46:26.622 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/336 2023-08-10T11:46:26.622 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/336 2023-08-10T11:46:26.623 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:26.624 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:26.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:26.661 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-08-10T11:46:26.865 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:26.869 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:26.869 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:26.870 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:26.870 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:27.445 INFO:teuthology.orchestra.run.smithi161.stdout:generic/337 0s 2023-08-10T11:46:27.450 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/337 2023-08-10T11:46:27.450 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:27.452 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:27.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:27.460 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-08-10T11:46:27.693 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:27.697 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:27.697 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:27.698 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:27.698 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:27.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:46:27.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:46:28.040 INFO:teuthology.orchestra.run.smithi161.stdout:generic/338 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:46:28.044 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/338 2023-08-10T11:46:28.044 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/338 2023-08-10T11:46:28.044 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:46:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:28.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:46:28.077 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-08-10T11:46:28.285 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:46:28.289 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:46:28.290 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:46:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:46:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:46:57.849 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:46:57.852 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:47:22.985 INFO:teuthology.orchestra.run.smithi161.stdout:generic/339 54s 2023-08-10T11:47:23.014 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/339 2023-08-10T11:47:23.015 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:23.016 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:23.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:23.025 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-08-10T11:47:23.233 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:23.237 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:23.237 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:23.238 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:23.238 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:26.271 INFO:teuthology.orchestra.run.smithi161.stdout:generic/340 3s 2023-08-10T11:47:26.288 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/340 2023-08-10T11:47:26.288 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:26.291 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:26.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:26.300 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-08-10T11:47:26.581 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:26.591 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:26.591 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:26.592 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:26.593 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:27.094 INFO:teuthology.orchestra.run.smithi161.stdout:generic/341 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:47:27.098 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/341 2023-08-10T11:47:27.098 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/341 2023-08-10T11:47:27.098 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:27.100 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:27.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:27.121 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-08-10T11:47:27.333 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:27.339 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:27.339 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:27.672 INFO:teuthology.orchestra.run.smithi161.stdout:generic/342 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:47:27.676 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/342 2023-08-10T11:47:27.676 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/342 2023-08-10T11:47:27.677 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:27.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:27.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:27.704 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-08-10T11:47:27.919 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:27.923 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:27.924 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:27.924 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:28.144 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:47:28.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:47:28.246 INFO:teuthology.orchestra.run.smithi161.stdout:generic/343 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:47:28.250 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/343 2023-08-10T11:47:28.250 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/343 2023-08-10T11:47:28.250 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:28.252 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:28.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:28.275 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-08-10T11:47:28.471 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:28.475 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:28.475 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:28.476 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:28.476 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:33.656 INFO:teuthology.orchestra.run.smithi161.stdout:generic/344 5s 2023-08-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/344 2023-08-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:33.674 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:33.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:33.692 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-08-10T11:47:34.033 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:34.038 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:34.041 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:34.042 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:34.042 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:39.667 INFO:teuthology.orchestra.run.smithi161.stdout:generic/345 5s 2023-08-10T11:47:39.681 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/345 2023-08-10T11:47:39.681 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:39.686 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:39.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:39.707 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-08-10T11:47:40.117 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:40.121 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:40.121 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:40.123 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:40.123 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:43.333 INFO:teuthology.orchestra.run.smithi161.stdout:generic/346 3s 2023-08-10T11:47:43.369 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/346 2023-08-10T11:47:43.369 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:43.371 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:43.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:43.383 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-08-10T11:47:43.692 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:43.702 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:43.703 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:43.708 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:43.709 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:44.218 INFO:teuthology.orchestra.run.smithi161.stdout:generic/347 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:47:44.222 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/347 2023-08-10T11:47:44.222 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/347 2023-08-10T11:47:44.222 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:44.224 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:44.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:44.245 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-08-10T11:47:44.466 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:44.470 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:44.471 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:44.472 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:44.472 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:44.817 INFO:teuthology.orchestra.run.smithi161.stdout:generic/348 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:47:44.822 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/348 2023-08-10T11:47:44.822 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/348 2023-08-10T11:47:44.822 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:44.824 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:44.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:44.849 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-08-10T11:47:45.059 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:45.063 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:45.063 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:45.064 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:45.064 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:45.498 INFO:teuthology.orchestra.run.smithi161.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-10T11:47:45.501 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/349 2023-08-10T11:47:45.502 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/349 2023-08-10T11:47:45.502 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:45.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:45.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:45.532 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-08-10T11:47:45.727 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:45.731 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:46.646 INFO:teuthology.orchestra.run.smithi161.stdout:generic/350 1s 2023-08-10T11:47:46.650 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/350 2023-08-10T11:47:46.651 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:46.653 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:46.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:46.661 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-08-10T11:47:46.882 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:46.886 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:46.887 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:46.888 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:46.888 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:47.232 INFO:teuthology.orchestra.run.smithi161.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:47:47.235 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/351 2023-08-10T11:47:47.236 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/351 2023-08-10T11:47:47.236 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:47.238 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:47.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:47.262 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-08-10T11:47:47.487 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:47.491 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:47.492 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:47.493 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:47.493 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:48.119 INFO:teuthology.orchestra.run.smithi161.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:47:48.125 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/352 2023-08-10T11:47:48.126 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/352 2023-08-10T11:47:48.126 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:48.212 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:48.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:48.390 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-08-10T11:47:48.596 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:48.600 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:48.600 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:48.601 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:48.601 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:49.338 INFO:teuthology.orchestra.run.smithi161.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:47:49.385 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/353 2023-08-10T11:47:49.386 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/353 2023-08-10T11:47:49.386 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:49.423 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:49.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:49.507 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-08-10T11:47:49.710 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:49.714 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:49.715 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:49.715 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:49.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:54.620 INFO:teuthology.orchestra.run.smithi161.stdout:generic/354 5s 2023-08-10T11:47:54.654 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/354 2023-08-10T11:47:54.655 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:54.661 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:54.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:54.672 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-08-10T11:47:55.017 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:55.022 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:55.022 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:55.023 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:55.024 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:55.916 INFO:teuthology.orchestra.run.smithi161.stdout:generic/355 0s 2023-08-10T11:47:55.925 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/355 2023-08-10T11:47:55.926 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:55.927 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:56.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:56.278 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-08-10T11:47:56.519 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:56.523 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:56.524 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:56.525 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:56.525 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:57.125 INFO:teuthology.orchestra.run.smithi161.stdout:generic/356 [not run] swapfiles are not supported 2023-08-10T11:47:57.129 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/356 2023-08-10T11:47:57.129 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/356 2023-08-10T11:47:57.130 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:57.131 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:57.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:57.154 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-08-10T11:47:57.358 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:57.362 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:57.362 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:57.363 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:57.363 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:57.904 INFO:teuthology.orchestra.run.smithi161.stdout:generic/357 [not run] swapfiles are not supported 2023-08-10T11:47:57.908 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/357 2023-08-10T11:47:57.909 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/357 2023-08-10T11:47:57.909 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:57.910 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:57.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:57.939 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-08-10T11:47:58.171 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:58.175 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:58.175 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:58.176 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:58.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:58.232 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:47:58.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:47:58.912 INFO:teuthology.orchestra.run.smithi161.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:47:58.926 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/358 2023-08-10T11:47:58.926 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/358 2023-08-10T11:47:58.926 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:47:58.999 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:47:59.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:47:59.079 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-08-10T11:47:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:47:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:47:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:47:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:47:59.324 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:00.196 INFO:teuthology.orchestra.run.smithi161.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:00.203 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/359 2023-08-10T11:48:00.203 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/359 2023-08-10T11:48:00.204 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:00.214 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:00.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:00.235 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-08-10T11:48:00.437 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:00.441 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:00.442 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:00.443 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:00.443 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:00.789 INFO:teuthology.orchestra.run.smithi161.stdout:generic/360 0s 2023-08-10T11:48:00.794 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/360 2023-08-10T11:48:00.795 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:00.796 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:00.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:00.824 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-08-10T11:48:01.023 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:01.027 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:01.027 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:01.028 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:01.028 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:01.352 INFO:teuthology.orchestra.run.smithi161.stdout:generic/361 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:48:01.356 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/361 2023-08-10T11:48:01.356 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/361 2023-08-10T11:48:01.357 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:01.358 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:01.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:01.384 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-08-10T11:48:01.597 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:01.601 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:01.601 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:01.602 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:01.602 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:01.926 INFO:teuthology.orchestra.run.smithi161.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:01.930 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/362 2023-08-10T11:48:01.930 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/362 2023-08-10T11:48:01.930 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:01.932 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:01.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:01.953 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-08-10T11:48:02.185 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:02.190 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:02.190 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:02.501 INFO:teuthology.orchestra.run.smithi161.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:02.505 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/363 2023-08-10T11:48:02.506 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/363 2023-08-10T11:48:02.506 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:02.507 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:02.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:02.534 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-08-10T11:48:02.742 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:02.746 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:02.747 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:02.748 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:02.748 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:03.083 INFO:teuthology.orchestra.run.smithi161.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:03.087 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/364 2023-08-10T11:48:03.087 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/364 2023-08-10T11:48:03.087 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:03.089 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:03.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:03.108 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-08-10T11:48:03.303 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:03.307 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:03.307 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:03.308 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:03.308 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:03.630 INFO:teuthology.orchestra.run.smithi161.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:03.634 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/365 2023-08-10T11:48:03.635 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/365 2023-08-10T11:48:03.635 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:03.636 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:03.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:03.668 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-08-10T11:48:03.879 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:03.883 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:03.884 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:03.885 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:03.885 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:04.189 INFO:teuthology.orchestra.run.smithi161.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:04.193 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/366 2023-08-10T11:48:04.194 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/366 2023-08-10T11:48:04.194 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:04.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:04.221 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-08-10T11:48:04.427 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:04.432 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:04.432 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:04.433 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:04.433 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:04.748 INFO:teuthology.orchestra.run.smithi161.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:04.752 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/367 2023-08-10T11:48:04.753 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/367 2023-08-10T11:48:04.753 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:04.754 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:04.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:04.782 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-08-10T11:48:04.987 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:04.992 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:04.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:05.307 INFO:teuthology.orchestra.run.smithi161.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:05.311 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/368 2023-08-10T11:48:05.311 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/368 2023-08-10T11:48:05.311 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:05.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:05.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:05.342 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-08-10T11:48:05.572 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:05.576 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:05.577 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:05.578 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:05.578 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:05.909 INFO:teuthology.orchestra.run.smithi161.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:05.913 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/369 2023-08-10T11:48:05.914 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/369 2023-08-10T11:48:05.914 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:05.915 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:05.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:05.934 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-08-10T11:48:06.137 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:06.141 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:06.141 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:06.142 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:06.143 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:06.453 INFO:teuthology.orchestra.run.smithi161.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-08-10T11:48:06.457 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/370 2023-08-10T11:48:06.457 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/370 2023-08-10T11:48:06.457 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:06.459 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:06.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:06.481 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-08-10T11:48:06.699 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:06.703 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:06.703 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:06.704 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:06.704 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:07.015 INFO:teuthology.orchestra.run.smithi161.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:48:07.019 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/371 2023-08-10T11:48:07.019 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/371 2023-08-10T11:48:07.019 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:07.021 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:07.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:07.044 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-08-10T11:48:07.248 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:07.253 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:07.253 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:07.254 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:07.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:07.971 INFO:teuthology.orchestra.run.smithi161.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:07.980 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/372 2023-08-10T11:48:07.980 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/372 2023-08-10T11:48:07.980 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:07.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:08.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:08.174 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-08-10T11:48:08.374 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:08.378 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:08.378 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:08.379 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:08.379 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:09.197 INFO:teuthology.orchestra.run.smithi161.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/373 2023-08-10T11:48:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/373 2023-08-10T11:48:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:09.220 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:09.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:09.294 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-08-10T11:48:09.509 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:09.513 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:09.514 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:09.514 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:09.514 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:10.009 INFO:teuthology.orchestra.run.smithi161.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-08-10T11:48:10.305 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/374 2023-08-10T11:48:10.305 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/374 2023-08-10T11:48:10.306 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:10.379 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:10.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:10.430 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-08-10T11:48:10.632 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:10.635 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:10.636 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:10.637 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:10.637 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:11.031 INFO:teuthology.orchestra.run.smithi161.stdout:generic/375 1s 2023-08-10T11:48:11.036 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/375 2023-08-10T11:48:11.036 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:11.038 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:11.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:11.349 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-08-10T11:48:11.651 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:11.656 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:11.657 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:11.657 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:11.658 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:11.988 INFO:teuthology.orchestra.run.smithi161.stdout:generic/376 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:48:11.992 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/376 2023-08-10T11:48:11.993 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/376 2023-08-10T11:48:11.993 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:11.995 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:12.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:12.013 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-08-10T11:48:12.219 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:12.223 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:12.224 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:12.224 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:12.224 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:generic/377 0s 2023-08-10T11:48:12.830 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/377 2023-08-10T11:48:12.830 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:12.832 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:12.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:12.840 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-08-10T11:48:13.058 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:13.062 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:13.063 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:13.063 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:13.064 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:13.515 INFO:teuthology.orchestra.run.smithi161.stdout:generic/378 0s 2023-08-10T11:48:13.519 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/378 2023-08-10T11:48:13.520 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:13.522 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:13.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:13.752 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-08-10T11:48:14.109 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:14.113 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:14.113 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:14.114 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:14.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:14.450 INFO:teuthology.orchestra.run.smithi161.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:14.454 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/379 2023-08-10T11:48:14.455 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/379 2023-08-10T11:48:14.455 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:14.456 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:14.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:14.480 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-08-10T11:48:14.691 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:14.695 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:14.696 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:14.697 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:14.697 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:15.009 INFO:teuthology.orchestra.run.smithi161.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/380 2023-08-10T11:48:15.014 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/380 2023-08-10T11:48:15.014 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:15.016 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:15.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:15.037 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-08-10T11:48:15.237 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:15.241 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:15.242 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:15.242 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:15.243 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:15.578 INFO:teuthology.orchestra.run.smithi161.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:15.582 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/381 2023-08-10T11:48:15.582 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/381 2023-08-10T11:48:15.583 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:15.584 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:15.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:15.611 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-08-10T11:48:15.817 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:15.821 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:15.821 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:15.822 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:15.823 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:16.159 INFO:teuthology.orchestra.run.smithi161.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:16.163 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/382 2023-08-10T11:48:16.163 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/382 2023-08-10T11:48:16.163 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:16.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:16.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:16.202 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-08-10T11:48:16.430 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:16.434 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:16.434 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:16.435 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:16.435 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:16.749 INFO:teuthology.orchestra.run.smithi161.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:16.753 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/383 2023-08-10T11:48:16.753 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/383 2023-08-10T11:48:16.754 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:16.755 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:16.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:16.783 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-08-10T11:48:16.986 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:16.990 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:16.991 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:16.992 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:16.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:17.308 INFO:teuthology.orchestra.run.smithi161.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:17.312 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/384 2023-08-10T11:48:17.312 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/384 2023-08-10T11:48:17.312 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:17.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:17.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:17.341 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-08-10T11:48:17.547 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:17.551 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:17.552 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:17.553 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:17.553 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:17.875 INFO:teuthology.orchestra.run.smithi161.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:17.879 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/385 2023-08-10T11:48:17.879 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/385 2023-08-10T11:48:17.879 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:17.881 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:17.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:17.905 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-08-10T11:48:18.119 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:18.123 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:18.123 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:18.124 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:18.124 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:18.437 INFO:teuthology.orchestra.run.smithi161.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:18.441 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/386 2023-08-10T11:48:18.441 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/386 2023-08-10T11:48:18.441 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:18.443 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:18.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:18.469 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-08-10T11:48:18.691 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:18.695 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:18.696 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:18.697 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:18.697 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:19.546 INFO:teuthology.orchestra.run.smithi161.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:19.554 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/387 2023-08-10T11:48:19.554 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/387 2023-08-10T11:48:19.555 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:19.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:19.649 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-08-10T11:48:19.871 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:19.875 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:19.876 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:19.876 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:19.876 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:20.248 INFO:teuthology.orchestra.run.smithi161.stdout:generic/388 [not run] require 172.21.15.161:6789:/scratch to be local device 2023-08-10T11:48:20.252 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/388 2023-08-10T11:48:20.252 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/388 2023-08-10T11:48:20.252 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:20.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:20.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:20.282 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-08-10T11:48:20.489 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:20.493 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:20.494 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:20.494 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:20.495 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-08-10T11:48:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/389 2023-08-10T11:48:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/389 2023-08-10T11:48:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:20.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:20.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:20.854 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-08-10T11:48:21.086 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:21.090 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:21.091 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:21.091 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:21.092 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:21.427 INFO:teuthology.orchestra.run.smithi161.stdout:generic/390 [not run] ceph does not support freezing 2023-08-10T11:48:21.431 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/390 2023-08-10T11:48:21.431 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/390 2023-08-10T11:48:21.431 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:21.433 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:21.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:21.460 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-08-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:21.674 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:21.674 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:21.675 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:21.675 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:22.013 INFO:teuthology.orchestra.run.smithi161.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:48:22.017 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/391 2023-08-10T11:48:22.018 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/391 2023-08-10T11:48:22.018 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:22.020 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:22.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:22.047 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-08-10T11:48:22.251 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:22.255 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:22.255 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:22.256 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:22.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:22.751 INFO:teuthology.orchestra.run.smithi161.stdout:generic/392 [not run] ceph does not support shutdown 2023-08-10T11:48:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/392 2023-08-10T11:48:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/392 2023-08-10T11:48:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:22.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:22.813 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-08-10T11:48:23.014 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:23.018 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:23.019 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:23.019 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:23.020 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:24.018 INFO:teuthology.orchestra.run.smithi161.stdout:generic/393 1s 2023-08-10T11:48:24.023 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/393 2023-08-10T11:48:24.023 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:24.025 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:24.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:24.034 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-08-10T11:48:24.236 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:24.240 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:24.240 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:24.241 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:24.241 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:24.617 INFO:teuthology.orchestra.run.smithi161.stdout:generic/394 0s 2023-08-10T11:48:24.621 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/394 2023-08-10T11:48:24.622 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:24.624 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:24.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:24.931 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-08-10T11:48:25.217 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:25.221 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:25.222 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:25.223 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:25.223 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:25.887 INFO:teuthology.orchestra.run.smithi161.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-08-10T11:48:25.907 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/395 2023-08-10T11:48:25.907 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/395 2023-08-10T11:48:25.907 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:25.910 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:25.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:25.936 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-08-10T11:48:26.267 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:26.272 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:26.272 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:26.273 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:26.273 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:26.984 INFO:teuthology.orchestra.run.smithi161.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-08-10T11:48:27.005 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/396 2023-08-10T11:48:27.005 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/396 2023-08-10T11:48:27.006 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:27.007 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:27.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:27.034 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-08-10T11:48:27.251 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:27.255 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:27.256 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:27.257 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:27.257 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:27.807 INFO:teuthology.orchestra.run.smithi161.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-08-10T11:48:27.823 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/397 2023-08-10T11:48:27.824 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/397 2023-08-10T11:48:27.824 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:27.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:27.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:27.849 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-08-10T11:48:28.050 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:28.054 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:28.055 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:28.056 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:28.056 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:28.312 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:48:28.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:48:28.604 INFO:teuthology.orchestra.run.smithi161.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-08-10T11:48:28.626 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/398 2023-08-10T11:48:28.626 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/398 2023-08-10T11:48:28.626 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:28.627 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:28.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:28.649 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-08-10T11:48:28.856 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:28.860 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:28.860 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:28.861 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:28.861 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:29.431 INFO:teuthology.orchestra.run.smithi161.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-08-10T11:48:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/399 2023-08-10T11:48:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/399 2023-08-10T11:48:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:29.453 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:29.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:29.474 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-08-10T11:48:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:30.037 INFO:teuthology.orchestra.run.smithi161.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-10T11:48:30.041 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/400 2023-08-10T11:48:30.041 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/400 2023-08-10T11:48:30.041 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:30.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:30.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:30.065 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-08-10T11:48:30.296 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:30.300 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:30.301 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:30.302 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:30.302 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:31.196 INFO:teuthology.orchestra.run.smithi161.stdout:generic/401 1s 2023-08-10T11:48:31.203 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/401 2023-08-10T11:48:31.203 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:31.205 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:31.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:31.215 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-08-10T11:48:31.435 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:31.440 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:31.440 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:31.441 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:31.441 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:31.951 INFO:teuthology.orchestra.run.smithi161.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-08-10T11:48:31.968 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/402 2023-08-10T11:48:31.968 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/402 2023-08-10T11:48:31.968 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:31.970 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:31.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:31.999 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-08-10T11:48:32.213 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:32.217 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:32.217 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:32.218 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:32.218 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:32.900 INFO:teuthology.orchestra.run.smithi161.stdout:generic/403 0s 2023-08-10T11:48:32.905 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/403 2023-08-10T11:48:32.905 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:32.907 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:32.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:32.916 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-08-10T11:48:33.150 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:33.154 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:33.155 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:33.156 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:33.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:33.485 INFO:teuthology.orchestra.run.smithi161.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:48:33.489 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/404 2023-08-10T11:48:33.490 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/404 2023-08-10T11:48:33.490 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:33.491 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:33.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:33.520 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-08-10T11:48:33.723 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:33.729 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:34.096 INFO:teuthology.orchestra.run.smithi161.stdout:generic/405 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:48:34.100 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/405 2023-08-10T11:48:34.100 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/405 2023-08-10T11:48:34.100 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:34.102 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:34.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:34.124 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-08-10T11:48:34.332 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:34.336 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:34.336 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:34.337 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:34.337 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:36.126 INFO:teuthology.orchestra.run.smithi161.stdout:generic/406 2s 2023-08-10T11:48:36.130 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/406 2023-08-10T11:48:36.131 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:36.132 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:36.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:36.141 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-08-10T11:48:36.346 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:36.350 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:36.351 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:36.351 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:36.352 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:36.750 INFO:teuthology.orchestra.run.smithi161.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:48:36.754 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/407 2023-08-10T11:48:36.754 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/407 2023-08-10T11:48:36.754 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:36.756 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:37.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:37.115 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-08-10T11:48:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:37.371 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:37.372 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:37.372 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:37.373 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:37.747 INFO:teuthology.orchestra.run.smithi161.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-10T11:48:37.751 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/408 2023-08-10T11:48:37.752 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/408 2023-08-10T11:48:37.752 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:37.754 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:38.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:38.079 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-08-10T11:48:38.358 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:38.362 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:38.363 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:38.364 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:38.683 INFO:teuthology.orchestra.run.smithi161.stdout:generic/409 [not run] require 172.21.15.161:6789:/scratch to be local device 2023-08-10T11:48:38.687 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/409 2023-08-10T11:48:38.687 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/409 2023-08-10T11:48:38.687 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:38.689 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:38.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:38.717 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-08-10T11:48:38.920 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:38.923 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:38.924 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:38.925 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:38.925 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:39.243 INFO:teuthology.orchestra.run.smithi161.stdout:generic/410 [not run] require 172.21.15.161:6789:/scratch to be local device 2023-08-10T11:48:39.247 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/410 2023-08-10T11:48:39.247 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/410 2023-08-10T11:48:39.247 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:39.249 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:39.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:39.273 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-08-10T11:48:39.490 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:39.494 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:39.495 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:39.496 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:39.496 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:39.830 INFO:teuthology.orchestra.run.smithi161.stdout:generic/411 [not run] require 172.21.15.161:6789:/scratch to be local device 2023-08-10T11:48:39.834 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/411 2023-08-10T11:48:39.834 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/411 2023-08-10T11:48:39.834 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:39.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:39.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:39.860 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-08-10T11:48:40.082 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:40.086 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:40.087 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:40.088 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:40.088 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:40.788 INFO:teuthology.orchestra.run.smithi161.stdout:generic/412 0s 2023-08-10T11:48:40.793 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/412 2023-08-10T11:48:40.793 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:40.795 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:40.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:40.804 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-08-10T11:48:41.004 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:41.008 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:41.009 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:41.009 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:41.010 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:41.492 INFO:teuthology.orchestra.run.smithi161.stdout:generic/413 [not run] mount 172.21.15.161:6789:/scratch with dax failed 2023-08-10T11:48:41.497 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/413 2023-08-10T11:48:41.497 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/413 2023-08-10T11:48:41.497 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:41.499 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:41.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:41.534 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-08-10T11:48:41.766 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:41.770 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:41.770 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:41.771 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:42.598 INFO:teuthology.orchestra.run.smithi161.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:42.656 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/414 2023-08-10T11:48:42.656 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/414 2023-08-10T11:48:42.657 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:42.660 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:42.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:42.712 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-08-10T11:48:42.930 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:42.934 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:42.935 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:42.935 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:42.936 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:48:43.740 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/415 2023-08-10T11:48:43.740 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/415 2023-08-10T11:48:43.740 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:43.743 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:43.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:43.843 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-08-10T11:48:44.068 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:44.072 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:44.072 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:44.073 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:44.073 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:44.412 INFO:teuthology.orchestra.run.smithi161.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:48:44.415 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/416 2023-08-10T11:48:44.415 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/416 2023-08-10T11:48:44.416 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:44.417 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:44.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:44.444 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-08-10T11:48:44.646 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:44.650 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:44.651 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:44.652 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:44.652 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:45.115 INFO:teuthology.orchestra.run.smithi161.stdout:generic/417 [not run] ceph does not support shutdown 2023-08-10T11:48:45.140 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/417 2023-08-10T11:48:45.141 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/417 2023-08-10T11:48:45.141 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:45.142 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:45.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:45.162 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-08-10T11:48:45.362 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:45.366 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:45.367 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:45.368 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:45.368 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:45.742 INFO:teuthology.orchestra.run.smithi161.stdout:generic/418 [not run] require 172.21.15.161:6789:/test to be valid block disk 2023-08-10T11:48:45.746 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/418 2023-08-10T11:48:45.746 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/418 2023-08-10T11:48:45.746 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:45.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:45.780 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-08-10T11:48:46.010 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:46.014 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:46.014 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:46.015 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:46.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:46.532 INFO:teuthology.orchestra.run.smithi161.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-08-10T11:48:46.560 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/419 2023-08-10T11:48:46.560 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/419 2023-08-10T11:48:46.561 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:46.562 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:46.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:46.583 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-08-10T11:48:46.788 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:46.791 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:46.792 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:46.793 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:46.793 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:47.234 INFO:teuthology.orchestra.run.smithi161.stdout:generic/420 1s 2023-08-10T11:48:47.239 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/420 2023-08-10T11:48:47.239 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:47.241 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:47.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:47.602 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-08-10T11:48:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:47.847 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:47.848 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:47.848 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:48.380 INFO:teuthology.orchestra.run.smithi161.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-08-10T11:48:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/421 2023-08-10T11:48:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/421 2023-08-10T11:48:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:48.401 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:48.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:48.425 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-08-10T11:48:48.633 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:48.637 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:48.637 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:48.638 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:48.638 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:48.971 INFO:teuthology.orchestra.run.smithi161.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-10T11:48:48.975 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/422 2023-08-10T11:48:48.975 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/422 2023-08-10T11:48:48.976 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:48.977 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:49.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:49.001 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-08-10T11:48:49.220 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:49.223 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:49.224 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:49.225 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:49.225 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:49.656 INFO:teuthology.orchestra.run.smithi161.stdout:generic/423 0s 2023-08-10T11:48:49.660 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/423 2023-08-10T11:48:49.661 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:49.662 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:49.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:49.860 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-08-10T11:48:50.251 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:50.255 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:50.255 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:50.256 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:50.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:50.600 INFO:teuthology.orchestra.run.smithi161.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-08-10T11:48:50.604 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/424 2023-08-10T11:48:50.604 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/424 2023-08-10T11:48:50.605 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:50.606 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:50.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:50.636 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-08-10T11:48:50.840 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:50.844 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:50.845 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:50.845 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:51.191 INFO:teuthology.orchestra.run.smithi161.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-08-10T11:48:51.194 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/425 2023-08-10T11:48:51.195 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/425 2023-08-10T11:48:51.195 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:48:51.196 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:51.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:48:51.401 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-08-10T11:48:51.815 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:48:51.819 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:48:51.820 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:48:51.820 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:48:51.821 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:48:58.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:48:58.514 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:49:28.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:49:28.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:49:34.536 INFO:teuthology.orchestra.run.smithi161.stdout:generic/426 42s 2023-08-10T11:49:34.648 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/426 2023-08-10T11:49:34.648 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:34.652 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:34.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:34.891 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-08-10T11:49:35.706 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:35.710 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:35.711 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:35.712 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:35.712 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:36.131 INFO:teuthology.orchestra.run.smithi161.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:49:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/427 2023-08-10T11:49:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/427 2023-08-10T11:49:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:36.137 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:36.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:36.170 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-08-10T11:49:36.401 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:36.405 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:36.406 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:36.407 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:36.407 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:36.764 INFO:teuthology.orchestra.run.smithi161.stdout:generic/428 0s 2023-08-10T11:49:36.769 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/428 2023-08-10T11:49:36.769 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:36.771 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:36.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:36.806 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-08-10T11:49:37.026 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:37.097 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:37.097 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:37.097 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:37.097 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:37.522 INFO:teuthology.orchestra.run.smithi161.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-08-10T11:49:37.542 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/429 2023-08-10T11:49:37.542 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/429 2023-08-10T11:49:37.542 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:37.543 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:37.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:37.572 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-08-10T11:49:37.767 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:37.771 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:37.772 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:37.773 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:37.773 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:38.189 INFO:teuthology.orchestra.run.smithi161.stdout:generic/430 1s 2023-08-10T11:49:38.194 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/430 2023-08-10T11:49:38.194 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:38.196 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:38.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:38.546 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-08-10T11:49:38.784 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:38.788 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:38.788 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:38.789 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:38.789 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:39.176 INFO:teuthology.orchestra.run.smithi161.stdout:generic/431 1s 2023-08-10T11:49:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/431 2023-08-10T11:49:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:39.183 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:39.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:39.407 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-08-10T11:49:39.769 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:39.773 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:39.774 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:39.775 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:39.775 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:generic/432 1s 2023-08-10T11:49:40.207 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/432 2023-08-10T11:49:40.207 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:40.209 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:40.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:40.584 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-08-10T11:49:40.831 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:40.836 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:40.836 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:40.837 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:40.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:41.198 INFO:teuthology.orchestra.run.smithi161.stdout:generic/433 0s 2023-08-10T11:49:41.210 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/433 2023-08-10T11:49:41.211 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:41.212 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:41.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:41.525 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-08-10T11:49:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:41.799 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:41.800 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:41.801 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:42.185 INFO:teuthology.orchestra.run.smithi161.stdout:generic/434 1s 2023-08-10T11:49:42.190 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/434 2023-08-10T11:49:42.190 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:42.192 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:42.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:42.572 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-08-10T11:49:42.816 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:42.820 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:42.821 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:42.822 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:42.822 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:43.331 INFO:teuthology.orchestra.run.smithi161.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-08-10T11:49:43.350 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/435 2023-08-10T11:49:43.350 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/435 2023-08-10T11:49:43.350 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:43.352 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:43.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:43.373 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-08-10T11:49:43.577 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:43.581 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:43.581 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:43.582 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:43.582 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:44.215 INFO:teuthology.orchestra.run.smithi161.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:49:44.219 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/436 2023-08-10T11:49:44.219 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/436 2023-08-10T11:49:44.219 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:44.221 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:44.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:44.553 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-08-10T11:49:44.780 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:44.785 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:44.785 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:44.786 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:44.786 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:generic/437 1s 2023-08-10T11:49:45.735 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/437 2023-08-10T11:49:45.735 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:49:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:45.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:49:45.770 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-08-10T11:49:46.002 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:49:46.006 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:49:46.007 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:49:46.007 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:49:46.008 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:49:59.592 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:49:59.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:50:29.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:50:29.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:50:43.476 INFO:teuthology.orchestra.run.smithi161.stdout:generic/438 57s 2023-08-10T11:50:43.481 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/438 2023-08-10T11:50:43.481 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:43.483 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:43.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:43.510 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-08-10T11:50:43.746 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:43.750 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:43.750 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:43.751 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:44.930 INFO:teuthology.orchestra.run.smithi161.stdout:generic/439 1s 2023-08-10T11:50:44.935 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/439 2023-08-10T11:50:44.935 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:44.937 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:44.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:44.967 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-08-10T11:50:45.172 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:45.176 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:45.176 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:45.177 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:45.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:45.721 INFO:teuthology.orchestra.run.smithi161.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-08-10T11:50:45.743 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/440 2023-08-10T11:50:45.743 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/440 2023-08-10T11:50:45.743 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:45.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:45.768 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-08-10T11:50:45.983 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:45.987 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:45.988 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:45.989 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:45.989 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:46.422 INFO:teuthology.orchestra.run.smithi161.stdout:generic/441 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:50:46.426 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/441 2023-08-10T11:50:46.426 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/441 2023-08-10T11:50:46.426 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:46.428 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:46.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:46.453 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-08-10T11:50:46.680 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:46.684 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:46.684 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:46.685 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:46.685 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:47.038 INFO:teuthology.orchestra.run.smithi161.stdout:generic/442 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:50:47.042 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/442 2023-08-10T11:50:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/442 2023-08-10T11:50:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:47.044 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:47.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:47.072 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-08-10T11:50:47.295 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:47.299 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:47.300 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:47.300 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:47.301 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:47.662 INFO:teuthology.orchestra.run.smithi161.stdout:generic/443 0s 2023-08-10T11:50:47.667 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/443 2023-08-10T11:50:47.667 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:47.669 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:47.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:47.698 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-08-10T11:50:47.914 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:47.918 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:47.919 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:47.920 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:47.920 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:48.349 INFO:teuthology.orchestra.run.smithi161.stdout:generic/444 0s 2023-08-10T11:50:48.354 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/444 2023-08-10T11:50:48.354 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:48.356 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:48.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:48.395 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-08-10T11:50:48.600 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:48.604 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:48.605 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:48.605 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:48.606 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:49.306 INFO:teuthology.orchestra.run.smithi161.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:50:49.310 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/445 2023-08-10T11:50:49.310 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/445 2023-08-10T11:50:49.311 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:50:49.312 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:50:49.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:50:49.592 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-08-10T11:50:49.912 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:50:49.916 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:50:49.917 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:50:49.918 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:50:49.918 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:00.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:51:00.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:51:10.069 INFO:teuthology.orchestra.run.smithi161.stdout:generic/446 20s 2023-08-10T11:51:10.081 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/446 2023-08-10T11:51:10.082 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:10.160 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:10.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:10.199 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-08-10T11:51:10.444 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:10.448 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:10.449 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:10.450 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:10.450 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:11.236 INFO:teuthology.orchestra.run.smithi161.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:51:11.336 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/447 2023-08-10T11:51:11.340 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/447 2023-08-10T11:51:11.340 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:11.349 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:11.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:11.386 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-08-10T11:51:11.592 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:11.596 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:11.596 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:11.597 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:11.597 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:12.699 INFO:teuthology.orchestra.run.smithi161.stdout:generic/448 1s 2023-08-10T11:51:12.705 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/448 2023-08-10T11:51:12.705 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:12.706 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:13.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:13.071 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-08-10T11:51:13.318 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:13.323 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:13.323 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:13.324 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:13.324 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:13.697 INFO:teuthology.orchestra.run.smithi161.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-10T11:51:13.701 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/449 2023-08-10T11:51:13.701 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/449 2023-08-10T11:51:13.701 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:13.703 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:14.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:14.027 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-08-10T11:51:14.301 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:14.305 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:14.305 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:14.306 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:14.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:15.101 INFO:teuthology.orchestra.run.smithi161.stdout:generic/450 1s 2023-08-10T11:51:15.106 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/450 2023-08-10T11:51:15.106 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:15.108 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:15.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:15.484 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-08-10T11:51:15.709 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:15.713 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:15.714 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:15.715 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:15.715 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:30.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:51:30.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:51:46.183 INFO:teuthology.orchestra.run.smithi161.stdout:generic/451 31s 2023-08-10T11:51:46.188 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/451 2023-08-10T11:51:46.188 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:46.190 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:46.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:46.281 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-08-10T11:51:46.790 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:46.794 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:46.795 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:46.795 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:46.796 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:generic/452 1s 2023-08-10T11:51:47.420 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/452 2023-08-10T11:51:47.420 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:47.422 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:47.431 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-08-10T11:51:47.640 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:47.644 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:47.645 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:47.646 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:47.646 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:47.981 INFO:teuthology.orchestra.run.smithi161.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-08-10T11:51:47.985 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/453 2023-08-10T11:51:47.985 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/453 2023-08-10T11:51:47.985 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:47.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:48.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:48.018 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-08-10T11:51:48.235 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:48.239 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:48.240 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:48.241 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:48.241 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:48.593 INFO:teuthology.orchestra.run.smithi161.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-08-10T11:51:48.597 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/454 2023-08-10T11:51:48.597 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/454 2023-08-10T11:51:48.598 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:48.599 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:48.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:48.629 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-08-10T11:51:48.864 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:48.868 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:48.869 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:48.870 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:48.870 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:49.282 INFO:teuthology.orchestra.run.smithi161.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-08-10T11:51:49.286 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/455 2023-08-10T11:51:49.286 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/455 2023-08-10T11:51:49.286 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:49.288 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:49.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:49.317 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-08-10T11:51:49.522 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:49.526 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:49.526 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:49.527 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:49.527 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:49.880 INFO:teuthology.orchestra.run.smithi161.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-10T11:51:49.884 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/456 2023-08-10T11:51:49.884 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/456 2023-08-10T11:51:49.884 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:49.886 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:49.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:49.916 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-08-10T11:51:50.140 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:50.144 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:50.144 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:50.145 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:50.145 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:51.054 INFO:teuthology.orchestra.run.smithi161.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:51:51.060 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/457 2023-08-10T11:51:51.061 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/457 2023-08-10T11:51:51.061 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:51.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:51.124 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-08-10T11:51:51.330 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:51.334 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:51.335 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:51.336 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:51.336 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:52.141 INFO:teuthology.orchestra.run.smithi161.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-08-10T11:51:52.230 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/458 2023-08-10T11:51:52.231 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/458 2023-08-10T11:51:52.231 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:52.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:52.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:52.306 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-08-10T11:51:52.542 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:52.546 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:52.547 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:52.547 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:52.548 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:53.078 INFO:teuthology.orchestra.run.smithi161.stdout:generic/459 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:51:53.082 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/459 2023-08-10T11:51:53.082 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/459 2023-08-10T11:51:53.082 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:53.084 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:53.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:53.113 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-08-10T11:51:53.350 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:53.354 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:53.354 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:53.355 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:53.355 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:55.374 INFO:teuthology.orchestra.run.smithi161.stdout:generic/460 2s 2023-08-10T11:51:55.379 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/460 2023-08-10T11:51:55.379 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:55.381 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:55.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:55.389 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-08-10T11:51:55.624 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:55.628 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:55.628 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:55.629 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:56.276 INFO:teuthology.orchestra.run.smithi161.stdout:generic/461 [not run] ceph does not support shutdown 2023-08-10T11:51:56.280 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/461 2023-08-10T11:51:56.281 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/461 2023-08-10T11:51:56.281 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:56.283 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:56.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:56.313 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-08-10T11:51:56.526 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:56.530 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:56.530 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:56.531 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:56.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:56.999 INFO:teuthology.orchestra.run.smithi161.stdout:generic/462 [not run] mount 172.21.15.161:6789:/scratch with dax failed 2023-08-10T11:51:57.003 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/462 2023-08-10T11:51:57.004 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/462 2023-08-10T11:51:57.004 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:57.006 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:57.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:57.033 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-08-10T11:51:57.246 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:57.251 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:57.251 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:57.252 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:57.252 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:57.647 INFO:teuthology.orchestra.run.smithi161.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-08-10T11:51:57.651 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/463 2023-08-10T11:51:57.651 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/463 2023-08-10T11:51:57.651 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:51:57.653 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:51:58.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:51:58.053 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-08-10T11:51:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:51:58.279 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:51:58.279 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:51:58.280 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:51:58.280 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:52:00.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:52:00.301 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:52:30.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:52:30.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:52:55.365 INFO:teuthology.orchestra.run.smithi161.stdout:generic/464 57s 2023-08-10T11:52:55.369 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/464 2023-08-10T11:52:55.370 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:52:55.371 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:52:55.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:52:55.380 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-08-10T11:52:55.585 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:52:55.589 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:52:55.590 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:52:55.591 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:52:55.591 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:00.291 INFO:teuthology.orchestra.run.smithi161.stdout:generic/465 4s 2023-08-10T11:53:00.299 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/465 2023-08-10T11:53:00.300 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:53:00.302 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:00.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:53:00.313 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-08-10T11:53:00.549 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:53:00.553 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:53:00.554 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:53:00.554 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:53:00.555 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:00.875 INFO:teuthology.orchestra.run.smithi161.stdout:generic/466 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:53:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/466 2023-08-10T11:53:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/466 2023-08-10T11:53:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:53:00.881 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:00.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:53:00.901 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-08-10T11:53:01.029 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:53:01.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:53:01.105 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:53:01.109 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:53:01.109 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:53:01.110 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:53:01.110 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:31.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:53:31.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:53:58.111 INFO:teuthology.orchestra.run.smithi161.stdout:generic/467 57s 2023-08-10T11:53:58.181 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/467 2023-08-10T11:53:58.187 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:53:58.205 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:53:58.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:53:58.589 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-08-10T11:53:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:53:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:53:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:53:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:53:59.571 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:00.146 INFO:teuthology.orchestra.run.smithi161.stdout:generic/468 [not run] ceph does not support shutdown 2023-08-10T11:54:00.176 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/468 2023-08-10T11:54:00.177 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/468 2023-08-10T11:54:00.177 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:00.178 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:00.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:00.202 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-08-10T11:54:00.414 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:00.418 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:00.418 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:00.419 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:00.419 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:00.766 INFO:teuthology.orchestra.run.smithi161.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-10T11:54:00.769 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/469 2023-08-10T11:54:00.770 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/469 2023-08-10T11:54:00.770 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:00.771 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:00.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:00.804 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-08-10T11:54:01.005 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:01.009 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:01.009 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:01.010 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:01.010 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:01.409 INFO:teuthology.orchestra.run.smithi161.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-08-10T11:54:01.413 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/470 2023-08-10T11:54:01.413 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/470 2023-08-10T11:54:01.413 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:01.415 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:01.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:01.443 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-08-10T11:54:01.649 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:01.653 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:01.653 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:01.654 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:01.654 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:01.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:54:01.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:54:02.070 INFO:teuthology.orchestra.run.smithi161.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-08-10T11:54:02.074 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/471 2023-08-10T11:54:02.074 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/471 2023-08-10T11:54:02.074 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:02.076 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:02.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:02.246 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-08-10T11:54:02.637 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:02.642 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:02.642 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:02.643 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:02.643 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:03.267 INFO:teuthology.orchestra.run.smithi161.stdout:generic/472 [not run] swapfiles are not supported 2023-08-10T11:54:03.271 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/472 2023-08-10T11:54:03.272 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/472 2023-08-10T11:54:03.272 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:03.273 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:03.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:03.303 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-08-10T11:54:03.512 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:03.513 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:03.513 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:03.514 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:03.514 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:03.875 INFO:teuthology.orchestra.run.smithi161.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-10T11:54:03.879 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/473 2023-08-10T11:54:03.880 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/473 2023-08-10T11:54:03.880 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:03.882 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:03.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:03.908 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-08-10T11:54:04.137 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:04.141 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:04.142 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:04.143 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:04.143 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:04.617 INFO:teuthology.orchestra.run.smithi161.stdout:generic/474 [not run] ceph does not support shutdown 2023-08-10T11:54:04.646 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/474 2023-08-10T11:54:04.647 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/474 2023-08-10T11:54:04.647 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:04.648 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:04.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:04.673 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-08-10T11:54:04.873 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:04.877 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:04.877 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:04.878 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:04.878 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:05.226 INFO:teuthology.orchestra.run.smithi161.stdout:generic/475 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2023-08-10T11:54:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Ran: generic/475 2023-08-10T11:54:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Not run: generic/475 2023-08-10T11:54:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:Passed all 1 tests 2023-08-10T11:54:05.233 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:05.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-10T11:54:05.259 DEBUG:teuthology.orchestra.run.smithi161:> (cd /tmp/tmp.arJpumkS1bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-08-10T11:54:05.475 INFO:teuthology.orchestra.run.smithi161.stdout:FSTYP -- ceph 2023-08-10T11:54:05.479 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM -- Linux/x86_64 smithi161 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-10T11:54:05.479 INFO:teuthology.orchestra.run.smithi161.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2023-08-10T11:54:05.480 INFO:teuthology.orchestra.run.smithi161.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC0u9RkdsCqGRAAvgNRdCjxs7e8Jj5G+XdNRw== -o context=system_u:object_r:root_t:s0 172.21.15.161:6789:/scratch /tmp/tmp.crTtBIQgBvscratch 2023-08-10T11:54:05.480 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-08-10T11:54:31.886 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:54:31.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:55:03.019 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:55:03.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:55:33.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:55:33.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:56:03.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:56:03.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:56:33.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:56:33.503 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:57:03.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:57:03.673 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:57:33.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:57:33.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:58:04.290 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:58:04.293 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:58:35.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:58:35.403 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T11:58:36.866 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T11:58:36.864+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149116) UID: 0 2023-08-10T11:58:36.874 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T11:58:36.864+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149116) UID: 0 2023-08-10T11:58:36.880 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T11:58:36.857+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149116) UID: 0 2023-08-10T11:58:36.897 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T11:58:36.854+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149116) UID: 0 2023-08-10T12:01:59.193 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:01:59.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:01:59.899 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T12:01:59.895+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149226) UID: 0 2023-08-10T12:01:59.904 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T12:01:59.903+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149226) UID: 0 2023-08-10T12:06:17.353 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T12:06:17.352+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149278) UID: 0 2023-08-10T12:06:17.356 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T12:06:17.356+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149278) UID: 0 2023-08-10T12:06:17.359 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T12:06:17.354+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149278) UID: 0 2023-08-10T12:06:17.360 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T12:06:17.354+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149278) UID: 0 2023-08-10T12:10:45.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:10:45.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:11:16.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:11:16.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:11:47.890 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:11:47.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:12:18.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:12:18.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:12:48.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:12:48.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:13:18.877 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:13:18.903 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:13:49.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:13:49.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:14:19.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:14:19.338 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:14:49.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:14:49.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:15:20.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:15:20.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:15:50.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:15:50.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:15:51.067 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-08-10T12:15:51.067+0000 7f127fd29700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149603) UID: 0 2023-08-10T12:15:51.073 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-08-10T12:15:51.067+0000 7f293297c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149603) UID: 0 2023-08-10T12:19:32.324 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T12:19:32.323+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149641) UID: 0 2023-08-10T12:19:32.326 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T12:19:32.325+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149641) UID: 0 2023-08-10T12:19:32.326 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T12:19:32.325+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149641) UID: 0 2023-08-10T12:19:32.327 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T12:19:32.325+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149641) UID: 0 2023-08-10T12:23:33.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:23:33.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T12:23:33.734 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-08-10T12:23:33.733+0000 7fa60693b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654987) UID: 0 2023-08-10T12:23:33.735 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-08-10T12:23:33.734+0000 7f91d129e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654987) UID: 0 2023-08-10T12:23:33.736 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-08-10T12:23:33.735+0000 7fbfda245700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654987) UID: 0 2023-08-10T12:23:33.742 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-08-10T12:23:33.739+0000 7f6ff6f5a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654987) UID: 0 2023-08-10T12:23:34.867 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-08-10T12:23:34.865+0000 7ff657dd7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149707) UID: 0 2023-08-10T12:23:34.868 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-08-10T12:23:34.865+0000 7fd95f661700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149707) UID: 0 2023-08-10T12:23:34.871 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-08-10T12:23:34.870+0000 7f608accf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149707) UID: 0 2023-08-10T12:23:34.871 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-08-10T12:23:34.865+0000 7f5ac4df0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149707) UID: 0 2023-08-10T12:27:00.767 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-08-10T12:27:00.766+0000 7f5c04dcd700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T12:27:01.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-08-10T12:27:01.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-08-10T12:27:01.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-08-10T12:27:01.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-08-10T12:27:01.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T12:27:01.113 INFO:teuthology.orchestra.run.smithi161.stdout:generic/476 2023-08-10T12:27:01.114 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-10T12:27:01.114 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-08-10T12:27:01.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:27:01.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:27:01.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:27:06.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-08-10T12:27:06.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-08-10T12:27:06.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-08-10T12:27:06.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-08-10T12:27:06.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-08-10T12:27:06.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-08-10T12:27:06.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-08-10T12:27:06.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-08-10T12:27:06.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-08-10T12:27:06.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-08-10T12:27:06.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~6s 2023-08-10T12:27:06.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-08-10T12:27:06.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-08-10T12:27:06.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2023-08-10T12:27:06.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-08-10T12:27:06.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-08-10T12:27:06.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~6s 2023-08-10T12:27:10.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:27:10.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:27:11.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-08-10T12:27:11.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2023-08-10T12:27:11.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2023-08-10T12:27:11.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-08-10T12:27:11.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2023-08-10T12:27:11.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2023-08-10T12:27:11.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-08-10T12:27:11.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2023-08-10T12:27:11.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~11s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~11s 2023-08-10T12:27:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~11s 2023-08-10T12:27:11.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~5s 2023-08-10T12:27:11.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~11s 2023-08-10T12:27:16.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2023-08-10T12:27:16.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2023-08-10T12:27:16.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2023-08-10T12:27:16.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2023-08-10T12:27:16.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2023-08-10T12:27:16.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~16s 2023-08-10T12:27:16.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2023-08-10T12:27:16.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2023-08-10T12:27:16.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~16s 2023-08-10T12:27:16.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~16s 2023-08-10T12:27:16.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~10s 2023-08-10T12:27:16.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~16s 2023-08-10T12:27:20.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:27:20.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:27:21.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2023-08-10T12:27:21.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2023-08-10T12:27:21.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2023-08-10T12:27:21.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2023-08-10T12:27:21.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2023-08-10T12:27:21.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2023-08-10T12:27:21.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2023-08-10T12:27:21.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2023-08-10T12:27:21.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2023-08-10T12:27:21.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2023-08-10T12:27:21.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~21s 2023-08-10T12:27:21.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2023-08-10T12:27:21.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2023-08-10T12:27:21.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~21s 2023-08-10T12:27:21.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~21s 2023-08-10T12:27:21.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~15s 2023-08-10T12:27:21.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~21s 2023-08-10T12:27:26.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-08-10T12:27:26.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2023-08-10T12:27:26.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-08-10T12:27:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-08-10T12:27:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2023-08-10T12:27:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-08-10T12:27:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2023-08-10T12:27:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~26s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-08-10T12:27:26.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2023-08-10T12:27:26.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-08-10T12:27:26.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~20s 2023-08-10T12:27:26.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~26s 2023-08-10T12:27:31.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2023-08-10T12:27:31.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2023-08-10T12:27:31.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2023-08-10T12:27:31.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2023-08-10T12:27:31.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2023-08-10T12:27:31.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2023-08-10T12:27:31.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2023-08-10T12:27:31.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2023-08-10T12:27:31.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2023-08-10T12:27:31.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2023-08-10T12:27:31.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~31s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~31s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~31s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~25s 2023-08-10T12:27:31.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~31s 2023-08-10T12:27:36.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2023-08-10T12:27:36.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2023-08-10T12:27:36.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2023-08-10T12:27:36.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2023-08-10T12:27:36.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2023-08-10T12:27:36.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2023-08-10T12:27:36.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2023-08-10T12:27:36.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2023-08-10T12:27:36.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2023-08-10T12:27:36.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2023-08-10T12:27:36.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~36s 2023-08-10T12:27:36.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2023-08-10T12:27:36.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2023-08-10T12:27:36.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~36s 2023-08-10T12:27:36.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~36s 2023-08-10T12:27:36.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~30s 2023-08-10T12:27:36.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~36s 2023-08-10T12:27:41.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2023-08-10T12:27:41.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-08-10T12:27:41.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-08-10T12:27:41.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2023-08-10T12:27:41.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2023-08-10T12:27:41.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2023-08-10T12:27:41.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2023-08-10T12:27:41.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2023-08-10T12:27:41.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2023-08-10T12:27:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2023-08-10T12:27:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~41s 2023-08-10T12:27:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2023-08-10T12:27:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2023-08-10T12:27:41.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~41s 2023-08-10T12:27:41.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~41s 2023-08-10T12:27:41.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~35s 2023-08-10T12:27:41.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~41s 2023-08-10T12:27:44.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:27:46.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-08-10T12:27:46.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2023-08-10T12:27:46.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-08-10T12:27:46.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-08-10T12:27:46.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2023-08-10T12:27:46.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-08-10T12:27:46.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2023-08-10T12:27:46.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2023-08-10T12:27:46.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2023-08-10T12:27:46.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~46s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-08-10T12:27:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~40s 2023-08-10T12:27:46.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~46s 2023-08-10T12:27:51.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2023-08-10T12:27:51.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2023-08-10T12:27:51.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2023-08-10T12:27:51.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2023-08-10T12:27:51.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2023-08-10T12:27:51.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~51s 2023-08-10T12:27:51.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2023-08-10T12:27:51.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2023-08-10T12:27:51.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2023-08-10T12:27:51.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~51s 2023-08-10T12:27:51.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~45s 2023-08-10T12:27:51.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~51s 2023-08-10T12:27:55.376 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:27:56.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2023-08-10T12:27:56.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2023-08-10T12:27:56.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2023-08-10T12:27:56.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2023-08-10T12:27:56.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2023-08-10T12:27:56.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2023-08-10T12:27:56.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2023-08-10T12:27:56.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2023-08-10T12:27:56.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2023-08-10T12:27:56.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2023-08-10T12:27:56.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~56s 2023-08-10T12:27:56.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2023-08-10T12:27:56.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2023-08-10T12:27:56.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~56s 2023-08-10T12:27:56.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~56s 2023-08-10T12:27:56.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~50s 2023-08-10T12:27:56.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~56s 2023-08-10T12:27:56.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:27:56.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:27:59.696 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:01.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2023-08-10T12:28:01.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2023-08-10T12:28:01.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2023-08-10T12:28:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2023-08-10T12:28:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2023-08-10T12:28:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2023-08-10T12:28:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2023-08-10T12:28:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~61s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2023-08-10T12:28:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~61s 2023-08-10T12:28:01.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~61s 2023-08-10T12:28:01.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~55s 2023-08-10T12:28:01.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~61s 2023-08-10T12:28:02.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:02.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:02.768 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:02.769 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-10T12:28:02.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:02.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:04.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:04.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:05.844 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:05.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:06.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-08-10T12:28:06.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2023-08-10T12:28:06.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2023-08-10T12:28:06.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2023-08-10T12:28:06.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2023-08-10T12:28:06.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~66s 2023-08-10T12:28:06.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2023-08-10T12:28:06.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2023-08-10T12:28:06.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~66s 2023-08-10T12:28:06.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-08-10T12:28:06.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~60s 2023-08-10T12:28:06.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~66s 2023-08-10T12:28:11.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-08-10T12:28:11.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-08-10T12:28:11.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-08-10T12:28:11.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-08-10T12:28:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2023-08-10T12:28:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2023-08-10T12:28:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2023-08-10T12:28:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2023-08-10T12:28:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2023-08-10T12:28:11.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2023-08-10T12:28:11.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~71s 2023-08-10T12:28:11.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-08-10T12:28:11.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-08-10T12:28:11.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~71s 2023-08-10T12:28:11.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~71s 2023-08-10T12:28:11.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~65s 2023-08-10T12:28:11.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~71s 2023-08-10T12:28:14.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:16.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2023-08-10T12:28:16.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2023-08-10T12:28:16.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2023-08-10T12:28:16.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2023-08-10T12:28:16.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2023-08-10T12:28:16.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2023-08-10T12:28:16.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2023-08-10T12:28:16.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2023-08-10T12:28:16.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2023-08-10T12:28:16.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2023-08-10T12:28:16.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~76s 2023-08-10T12:28:16.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2023-08-10T12:28:16.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2023-08-10T12:28:16.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-08-10T12:28:16.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~76s 2023-08-10T12:28:16.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~70s 2023-08-10T12:28:16.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~76s 2023-08-10T12:28:17.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:17.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:17.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:17.905 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:20.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:20.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:20.980 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:20.981 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-10T12:28:20.986 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/ceph.py", line 183, in invoke_logrotate File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi161 2023-08-10T12:28:21.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2023-08-10T12:28:21.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2023-08-10T12:28:21.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2023-08-10T12:28:21.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-08-10T12:28:21.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2023-08-10T12:28:21.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2023-08-10T12:28:21.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2023-08-10T12:28:21.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2023-08-10T12:28:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~75s 2023-08-10T12:28:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~75s 2023-08-10T12:28:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~81s 2023-08-10T12:28:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~75s 2023-08-10T12:28:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2023-08-10T12:28:21.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~81s 2023-08-10T12:28:21.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~81s 2023-08-10T12:28:21.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~75s 2023-08-10T12:28:21.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~81s 2023-08-10T12:28:26.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-08-10T12:28:26.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2023-08-10T12:28:26.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2023-08-10T12:28:26.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-08-10T12:28:26.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2023-08-10T12:28:26.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~86s 2023-08-10T12:28:26.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~80s 2023-08-10T12:28:26.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2023-08-10T12:28:26.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~86s 2023-08-10T12:28:26.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-08-10T12:28:26.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~80s 2023-08-10T12:28:26.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~86s 2023-08-10T12:28:29.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:29.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:31.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-08-10T12:28:31.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-08-10T12:28:31.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2023-08-10T12:28:31.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-08-10T12:28:31.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2023-08-10T12:28:31.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2023-08-10T12:28:31.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2023-08-10T12:28:31.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~85s 2023-08-10T12:28:31.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~85s 2023-08-10T12:28:31.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~85s 2023-08-10T12:28:31.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~91s 2023-08-10T12:28:31.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-08-10T12:28:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-08-10T12:28:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~91s 2023-08-10T12:28:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~91s 2023-08-10T12:28:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~85s 2023-08-10T12:28:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~91s 2023-08-10T12:28:32.980 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:35.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:35.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:36.048 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:36.049 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-10T12:28:36.049 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2023-08-10T12:28:36.050 INFO:tasks.cephfs_test_runner:ERROR 2023-08-10T12:28:36.050 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.050 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-10T12:28:36.051 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.051 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T12:28:36.051 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-10T12:28:36.052 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-08-10T12:28:36.052 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-08-10T12:28:36.052 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-08-10T12:28:36.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-08-10T12:28:36.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-08-10T12:28:36.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-10T12:28:36.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run 2023-08-10T12:28:36.053 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-08-10T12:28:36.054 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi161 2023-08-10T12:28:36.054 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.054 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-10T12:28:36.054 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.055 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T12:28:36.055 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-10T12:28:36.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-08-10T12:28:36.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-08-10T12:28:36.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run 2023-08-10T12:28:36.056 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-08-10T12:28:36.056 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi161 2023-08-10T12:28:36.056 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.056 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T12:28:36.057 INFO:tasks.cephfs_test_runner:Ran 1 test in 7139.251s 2023-08-10T12:28:36.057 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.057 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-08-10T12:28:36.057 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.058 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-10T12:28:36.058 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.058 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T12:28:36.058 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-10T12:28:36.058 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-08-10T12:28:36.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-08-10T12:28:36.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-08-10T12:28:36.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-08-10T12:28:36.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-08-10T12:28:36.060 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-10T12:28:36.060 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run 2023-08-10T12:28:36.060 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-08-10T12:28:36.060 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi161 2023-08-10T12:28:36.060 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.061 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-10T12:28:36.061 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.061 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T12:28:36.061 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-10T12:28:36.062 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-08-10T12:28:36.062 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-08-10T12:28:36.062 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run 2023-08-10T12:28:36.062 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-08-10T12:28:36.063 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi161 2023-08-10T12:28:36.063 INFO:tasks.cephfs_test_runner: 2023-08-10T12:28:36.063 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.137 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6ee4172d7c334bbbbf8c543dcf287053 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-10T12:28:36.139 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-10T12:28:36.154 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-10T12:28:36.166 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-10T12:28:36.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:28:36.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:36.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-08-10T12:28:36.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2023-08-10T12:28:36.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2023-08-10T12:28:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2023-08-10T12:28:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2023-08-10T12:28:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2023-08-10T12:28:36.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2023-08-10T12:28:36.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~90s 2023-08-10T12:28:36.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~90s 2023-08-10T12:28:36.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~90s 2023-08-10T12:28:36.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~97s 2023-08-10T12:28:36.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2023-08-10T12:28:36.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~90s 2023-08-10T12:28:36.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~97s 2023-08-10T12:28:36.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~97s 2023-08-10T12:28:36.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~90s 2023-08-10T12:28:36.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~97s 2023-08-10T12:28:41.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-08-10T12:28:41.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2023-08-10T12:28:41.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2023-08-10T12:28:41.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-08-10T12:28:41.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2023-08-10T12:28:41.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2023-08-10T12:28:41.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2023-08-10T12:28:41.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2023-08-10T12:28:41.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2023-08-10T12:28:41.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2023-08-10T12:28:41.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~102s 2023-08-10T12:28:41.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2023-08-10T12:28:41.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2023-08-10T12:28:41.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~102s 2023-08-10T12:28:41.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~102s 2023-08-10T12:28:41.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~95s 2023-08-10T12:28:41.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~102s 2023-08-10T12:28:46.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2023-08-10T12:28:46.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2023-08-10T12:28:46.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2023-08-10T12:28:46.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2023-08-10T12:28:46.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2023-08-10T12:28:46.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2023-08-10T12:28:46.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2023-08-10T12:28:46.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~100s 2023-08-10T12:28:46.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~100s 2023-08-10T12:28:46.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~100s 2023-08-10T12:28:46.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~107s 2023-08-10T12:28:46.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~100s 2023-08-10T12:28:46.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2023-08-10T12:28:46.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~107s 2023-08-10T12:28:46.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~107s 2023-08-10T12:28:46.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~100s 2023-08-10T12:28:46.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~107s 2023-08-10T12:28:51.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2023-08-10T12:28:51.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2023-08-10T12:28:51.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2023-08-10T12:28:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2023-08-10T12:28:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2023-08-10T12:28:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-08-10T12:28:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2023-08-10T12:28:51.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2023-08-10T12:28:51.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~105s 2023-08-10T12:28:51.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2023-08-10T12:28:51.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~112s 2023-08-10T12:28:51.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2023-08-10T12:28:51.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2023-08-10T12:28:51.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~112s 2023-08-10T12:28:51.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~112s 2023-08-10T12:28:51.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~105s 2023-08-10T12:28:51.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~112s 2023-08-10T12:28:54.512 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:28:56.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2023-08-10T12:28:56.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2023-08-10T12:28:56.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2023-08-10T12:28:56.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2023-08-10T12:28:56.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2023-08-10T12:28:56.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2023-08-10T12:28:56.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2023-08-10T12:28:56.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2023-08-10T12:28:56.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~110s 2023-08-10T12:28:56.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2023-08-10T12:28:56.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~117s 2023-08-10T12:28:56.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~110s 2023-08-10T12:28:56.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~110s 2023-08-10T12:28:56.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~117s 2023-08-10T12:28:56.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~117s 2023-08-10T12:28:56.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~110s 2023-08-10T12:28:56.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~117s 2023-08-10T12:29:01.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2023-08-10T12:29:01.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2023-08-10T12:29:01.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2023-08-10T12:29:01.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2023-08-10T12:29:01.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2023-08-10T12:29:01.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2023-08-10T12:29:01.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2023-08-10T12:29:01.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~115s 2023-08-10T12:29:01.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~115s 2023-08-10T12:29:01.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~115s 2023-08-10T12:29:01.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~122s 2023-08-10T12:29:01.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2023-08-10T12:29:01.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~115s 2023-08-10T12:29:01.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2023-08-10T12:29:01.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~122s 2023-08-10T12:29:01.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~115s 2023-08-10T12:29:01.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~122s 2023-08-10T12:29:03.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:29:03.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:29:04.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-08-10T12:29:06.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2023-08-10T12:29:06.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2023-08-10T12:29:06.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2023-08-10T12:29:06.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2023-08-10T12:29:06.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2023-08-10T12:29:06.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2023-08-10T12:29:06.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2023-08-10T12:29:06.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2023-08-10T12:29:06.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2023-08-10T12:29:06.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2023-08-10T12:29:06.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~127s 2023-08-10T12:29:06.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2023-08-10T12:29:06.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2023-08-10T12:29:06.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~127s 2023-08-10T12:29:06.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~127s 2023-08-10T12:29:06.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~120s 2023-08-10T12:29:06.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~127s 2023-08-10T12:29:11.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2023-08-10T12:29:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2023-08-10T12:29:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2023-08-10T12:29:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2023-08-10T12:29:11.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2023-08-10T12:29:11.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-08-10T12:29:11.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2023-08-10T12:29:11.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~125s 2023-08-10T12:29:11.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~125s 2023-08-10T12:29:11.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~125s 2023-08-10T12:29:11.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~132s 2023-08-10T12:29:11.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2023-08-10T12:29:11.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2023-08-10T12:29:11.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~132s 2023-08-10T12:29:11.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-08-10T12:29:11.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~125s 2023-08-10T12:29:11.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~132s 2023-08-10T12:29:16.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:29:16.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:29:16.194 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: Authentication failed. 2023-08-10T12:29:16.197 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-08-10T12:29:16.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T12:29:16.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2023-08-10T12:29:16.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-08-10T12:29:16.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2023-08-10T12:29:16.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-08-10T12:29:16.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2023-08-10T12:29:16.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2023-08-10T12:29:16.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2023-08-10T12:29:16.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~130s 2023-08-10T12:29:16.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~130s 2023-08-10T12:29:16.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~130s 2023-08-10T12:29:16.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~137s 2023-08-10T12:29:16.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-08-10T12:29:16.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2023-08-10T12:29:16.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~137s 2023-08-10T12:29:16.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~137s 2023-08-10T12:29:16.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~130s 2023-08-10T12:29:16.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~137s 2023-08-10T12:29:21.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2023-08-10T12:29:21.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2023-08-10T12:29:21.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2023-08-10T12:29:21.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2023-08-10T12:29:21.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2023-08-10T12:29:21.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2023-08-10T12:29:21.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2023-08-10T12:29:21.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~135s 2023-08-10T12:29:21.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~135s 2023-08-10T12:29:21.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~135s 2023-08-10T12:29:21.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~142s 2023-08-10T12:29:21.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~135s 2023-08-10T12:29:21.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~135s 2023-08-10T12:29:21.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~142s 2023-08-10T12:29:21.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~142s 2023-08-10T12:29:21.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~135s 2023-08-10T12:29:21.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~142s 2023-08-10T12:29:26.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2023-08-10T12:29:26.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2023-08-10T12:29:26.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2023-08-10T12:29:26.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2023-08-10T12:29:26.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2023-08-10T12:29:26.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2023-08-10T12:29:26.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2023-08-10T12:29:26.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~140s 2023-08-10T12:29:26.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~140s 2023-08-10T12:29:26.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~140s 2023-08-10T12:29:26.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~147s 2023-08-10T12:29:26.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2023-08-10T12:29:26.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2023-08-10T12:29:26.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~147s 2023-08-10T12:29:26.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~147s 2023-08-10T12:29:26.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~140s 2023-08-10T12:29:26.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~147s 2023-08-10T12:29:31.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-08-10T12:29:31.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2023-08-10T12:29:31.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-08-10T12:29:31.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-08-10T12:29:31.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2023-08-10T12:29:31.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-08-10T12:29:31.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2023-08-10T12:29:31.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2023-08-10T12:29:31.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2023-08-10T12:29:31.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2023-08-10T12:29:31.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~152s 2023-08-10T12:29:31.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2023-08-10T12:29:31.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-08-10T12:29:31.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~152s 2023-08-10T12:29:31.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-08-10T12:29:31.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~145s 2023-08-10T12:29:31.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~152s 2023-08-10T12:29:36.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2023-08-10T12:29:36.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2023-08-10T12:29:36.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2023-08-10T12:29:36.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-08-10T12:29:36.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2023-08-10T12:29:36.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2023-08-10T12:29:36.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2023-08-10T12:29:36.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~150s 2023-08-10T12:29:36.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~150s 2023-08-10T12:29:36.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~150s 2023-08-10T12:29:36.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~157s 2023-08-10T12:29:36.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-08-10T12:29:36.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2023-08-10T12:29:36.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~157s 2023-08-10T12:29:36.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~157s 2023-08-10T12:29:36.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~150s 2023-08-10T12:29:36.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~157s 2023-08-10T12:29:41.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2023-08-10T12:29:41.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2023-08-10T12:29:41.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2023-08-10T12:29:41.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2023-08-10T12:29:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2023-08-10T12:29:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2023-08-10T12:29:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2023-08-10T12:29:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2023-08-10T12:29:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~155s 2023-08-10T12:29:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~155s 2023-08-10T12:29:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~162s 2023-08-10T12:29:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~155s 2023-08-10T12:29:41.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~155s 2023-08-10T12:29:41.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~162s 2023-08-10T12:29:41.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~162s 2023-08-10T12:29:41.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~155s 2023-08-10T12:29:41.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~162s 2023-08-10T12:29:46.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2023-08-10T12:29:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-08-10T12:29:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2023-08-10T12:29:46.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2023-08-10T12:29:46.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2023-08-10T12:29:46.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2023-08-10T12:29:46.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2023-08-10T12:29:46.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~160s 2023-08-10T12:29:46.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2023-08-10T12:29:46.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2023-08-10T12:29:46.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~167s 2023-08-10T12:29:46.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~160s 2023-08-10T12:29:46.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~160s 2023-08-10T12:29:46.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~167s 2023-08-10T12:29:46.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~167s 2023-08-10T12:29:46.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~160s 2023-08-10T12:29:46.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~167s 2023-08-10T12:29:51.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-08-10T12:29:51.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-08-10T12:29:51.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-08-10T12:29:51.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-08-10T12:29:51.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2023-08-10T12:29:51.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-08-10T12:29:51.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2023-08-10T12:29:51.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~165s 2023-08-10T12:29:51.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2023-08-10T12:29:51.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2023-08-10T12:29:51.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~172s 2023-08-10T12:29:51.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2023-08-10T12:29:51.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-08-10T12:29:51.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~172s 2023-08-10T12:29:51.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-08-10T12:29:51.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~165s 2023-08-10T12:29:51.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~172s 2023-08-10T12:29:56.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-08-10T12:29:56.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2023-08-10T12:29:56.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2023-08-10T12:29:56.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-08-10T12:29:56.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2023-08-10T12:29:56.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2023-08-10T12:29:56.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2023-08-10T12:29:56.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2023-08-10T12:29:56.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2023-08-10T12:29:56.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2023-08-10T12:29:56.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~177s 2023-08-10T12:29:56.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2023-08-10T12:29:56.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~170s 2023-08-10T12:29:56.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~177s 2023-08-10T12:29:56.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~177s 2023-08-10T12:29:56.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~170s 2023-08-10T12:29:56.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~177s 2023-08-10T12:30:01.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-08-10T12:30:01.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2023-08-10T12:30:01.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2023-08-10T12:30:01.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-08-10T12:30:01.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2023-08-10T12:30:01.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2023-08-10T12:30:01.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2023-08-10T12:30:01.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~175s 2023-08-10T12:30:01.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~175s 2023-08-10T12:30:01.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~175s 2023-08-10T12:30:01.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~182s 2023-08-10T12:30:01.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~175s 2023-08-10T12:30:01.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~175s 2023-08-10T12:30:01.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~182s 2023-08-10T12:30:01.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~182s 2023-08-10T12:30:01.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~175s 2023-08-10T12:30:01.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~182s 2023-08-10T12:30:06.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-08-10T12:30:06.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2023-08-10T12:30:06.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2023-08-10T12:30:06.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2023-08-10T12:30:06.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2023-08-10T12:30:06.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2023-08-10T12:30:06.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2023-08-10T12:30:06.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2023-08-10T12:30:06.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~180s 2023-08-10T12:30:06.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~180s 2023-08-10T12:30:06.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~187s 2023-08-10T12:30:06.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~180s 2023-08-10T12:30:06.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~180s 2023-08-10T12:30:06.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~187s 2023-08-10T12:30:06.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~187s 2023-08-10T12:30:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~180s 2023-08-10T12:30:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~187s 2023-08-10T12:30:11.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-08-10T12:30:11.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2023-08-10T12:30:11.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-08-10T12:30:11.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-08-10T12:30:11.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2023-08-10T12:30:11.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-08-10T12:30:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2023-08-10T12:30:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~185s 2023-08-10T12:30:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2023-08-10T12:30:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~185s 2023-08-10T12:30:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~192s 2023-08-10T12:30:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2023-08-10T12:30:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-08-10T12:30:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~192s 2023-08-10T12:30:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-08-10T12:30:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~185s 2023-08-10T12:30:11.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~192s 2023-08-10T12:30:16.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2023-08-10T12:30:16.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2023-08-10T12:30:16.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2023-08-10T12:30:16.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2023-08-10T12:30:16.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2023-08-10T12:30:16.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-08-10T12:30:16.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2023-08-10T12:30:16.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~190s 2023-08-10T12:30:16.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~190s 2023-08-10T12:30:16.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2023-08-10T12:30:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~197s 2023-08-10T12:30:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2023-08-10T12:30:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2023-08-10T12:30:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~197s 2023-08-10T12:30:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~197s 2023-08-10T12:30:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~190s 2023-08-10T12:30:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~197s 2023-08-10T12:30:21.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2023-08-10T12:30:21.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2023-08-10T12:30:21.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2023-08-10T12:30:21.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-08-10T12:30:21.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2023-08-10T12:30:21.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2023-08-10T12:30:21.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2023-08-10T12:30:21.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~195s 2023-08-10T12:30:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~195s 2023-08-10T12:30:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~195s 2023-08-10T12:30:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~202s 2023-08-10T12:30:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2023-08-10T12:30:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-08-10T12:30:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~202s 2023-08-10T12:30:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~202s 2023-08-10T12:30:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~195s 2023-08-10T12:30:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~202s 2023-08-10T12:30:26.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2023-08-10T12:30:26.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2023-08-10T12:30:26.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2023-08-10T12:30:26.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2023-08-10T12:30:26.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2023-08-10T12:30:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2023-08-10T12:30:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2023-08-10T12:30:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~200s 2023-08-10T12:30:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2023-08-10T12:30:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2023-08-10T12:30:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~207s 2023-08-10T12:30:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~200s 2023-08-10T12:30:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2023-08-10T12:30:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~207s 2023-08-10T12:30:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~207s 2023-08-10T12:30:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~200s 2023-08-10T12:30:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~207s 2023-08-10T12:30:31.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-08-10T12:30:31.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2023-08-10T12:30:31.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-08-10T12:30:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-08-10T12:30:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2023-08-10T12:30:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-08-10T12:30:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-08-10T12:30:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2023-08-10T12:30:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2023-08-10T12:30:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2023-08-10T12:30:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~212s 2023-08-10T12:30:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2023-08-10T12:30:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-08-10T12:30:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~212s 2023-08-10T12:30:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~212s 2023-08-10T12:30:31.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~205s 2023-08-10T12:30:31.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~212s 2023-08-10T12:30:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2023-08-10T12:30:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2023-08-10T12:30:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2023-08-10T12:30:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2023-08-10T12:30:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2023-08-10T12:30:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2023-08-10T12:30:36.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2023-08-10T12:30:36.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~210s 2023-08-10T12:30:36.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~210s 2023-08-10T12:30:36.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~210s 2023-08-10T12:30:36.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~217s 2023-08-10T12:30:36.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2023-08-10T12:30:36.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~210s 2023-08-10T12:30:36.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~217s 2023-08-10T12:30:36.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~217s 2023-08-10T12:30:36.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~210s 2023-08-10T12:30:36.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~217s 2023-08-10T12:30:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2023-08-10T12:30:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-08-10T12:30:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2023-08-10T12:30:41.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-08-10T12:30:41.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2023-08-10T12:30:41.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2023-08-10T12:30:41.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2023-08-10T12:30:41.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2023-08-10T12:30:41.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2023-08-10T12:30:41.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2023-08-10T12:30:41.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~222s 2023-08-10T12:30:41.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2023-08-10T12:30:41.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-08-10T12:30:41.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~222s 2023-08-10T12:30:41.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~222s 2023-08-10T12:30:41.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~215s 2023-08-10T12:30:41.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~222s 2023-08-10T12:30:46.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2023-08-10T12:30:46.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2023-08-10T12:30:46.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2023-08-10T12:30:46.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2023-08-10T12:30:46.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2023-08-10T12:30:46.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2023-08-10T12:30:46.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2023-08-10T12:30:46.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~220s 2023-08-10T12:30:46.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~220s 2023-08-10T12:30:46.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~220s 2023-08-10T12:30:46.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~227s 2023-08-10T12:30:46.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~220s 2023-08-10T12:30:46.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2023-08-10T12:30:46.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~227s 2023-08-10T12:30:46.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~227s 2023-08-10T12:30:46.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~220s 2023-08-10T12:30:46.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~227s 2023-08-10T12:30:51.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-08-10T12:30:51.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2023-08-10T12:30:51.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-08-10T12:30:51.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-08-10T12:30:51.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2023-08-10T12:30:51.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-08-10T12:30:51.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2023-08-10T12:30:51.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~225s 2023-08-10T12:30:51.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2023-08-10T12:30:51.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~225s 2023-08-10T12:30:51.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~232s 2023-08-10T12:30:51.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2023-08-10T12:30:51.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-08-10T12:30:51.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~232s 2023-08-10T12:30:51.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~232s 2023-08-10T12:30:51.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~225s 2023-08-10T12:30:51.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~232s 2023-08-10T12:30:56.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2023-08-10T12:30:56.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2023-08-10T12:30:56.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2023-08-10T12:30:56.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2023-08-10T12:30:56.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2023-08-10T12:30:56.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2023-08-10T12:30:56.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2023-08-10T12:30:56.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2023-08-10T12:30:56.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~230s 2023-08-10T12:30:56.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~230s 2023-08-10T12:30:56.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~237s 2023-08-10T12:30:56.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2023-08-10T12:30:56.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2023-08-10T12:30:56.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~237s 2023-08-10T12:30:56.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~237s 2023-08-10T12:30:56.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~230s 2023-08-10T12:30:56.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~237s 2023-08-10T12:31:01.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2023-08-10T12:31:01.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2023-08-10T12:31:01.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2023-08-10T12:31:01.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2023-08-10T12:31:01.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2023-08-10T12:31:01.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2023-08-10T12:31:01.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2023-08-10T12:31:01.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~235s 2023-08-10T12:31:01.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~235s 2023-08-10T12:31:01.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~235s 2023-08-10T12:31:01.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~242s 2023-08-10T12:31:01.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2023-08-10T12:31:01.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2023-08-10T12:31:01.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~242s 2023-08-10T12:31:01.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~242s 2023-08-10T12:31:01.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~235s 2023-08-10T12:31:01.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~242s 2023-08-10T12:31:06.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2023-08-10T12:31:06.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2023-08-10T12:31:06.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2023-08-10T12:31:06.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2023-08-10T12:31:06.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2023-08-10T12:31:06.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2023-08-10T12:31:06.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2023-08-10T12:31:06.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2023-08-10T12:31:06.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2023-08-10T12:31:06.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2023-08-10T12:31:06.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~247s 2023-08-10T12:31:06.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~240s 2023-08-10T12:31:06.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2023-08-10T12:31:06.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~247s 2023-08-10T12:31:06.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~247s 2023-08-10T12:31:06.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~240s 2023-08-10T12:31:06.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~247s 2023-08-10T12:31:11.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-08-10T12:31:11.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2023-08-10T12:31:11.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-08-10T12:31:11.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-08-10T12:31:11.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2023-08-10T12:31:11.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-08-10T12:31:11.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2023-08-10T12:31:11.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~245s 2023-08-10T12:31:11.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2023-08-10T12:31:11.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2023-08-10T12:31:11.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~252s 2023-08-10T12:31:11.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2023-08-10T12:31:11.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-08-10T12:31:11.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~252s 2023-08-10T12:31:11.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~252s 2023-08-10T12:31:11.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~245s 2023-08-10T12:31:11.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~252s 2023-08-10T12:31:16.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2023-08-10T12:31:16.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2023-08-10T12:31:16.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2023-08-10T12:31:16.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2023-08-10T12:31:16.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2023-08-10T12:31:16.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2023-08-10T12:31:16.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2023-08-10T12:31:16.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~250s 2023-08-10T12:31:16.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~250s 2023-08-10T12:31:16.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~250s 2023-08-10T12:31:16.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~257s 2023-08-10T12:31:16.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~250s 2023-08-10T12:31:16.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2023-08-10T12:31:16.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~257s 2023-08-10T12:31:16.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~257s 2023-08-10T12:31:16.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~250s 2023-08-10T12:31:16.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~257s 2023-08-10T12:31:21.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-08-10T12:31:21.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2023-08-10T12:31:21.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2023-08-10T12:31:21.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-08-10T12:31:21.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2023-08-10T12:31:21.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-08-10T12:31:21.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2023-08-10T12:31:21.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2023-08-10T12:31:21.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~255s 2023-08-10T12:31:21.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~255s 2023-08-10T12:31:21.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~262s 2023-08-10T12:31:21.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~255s 2023-08-10T12:31:21.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~255s 2023-08-10T12:31:21.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~262s 2023-08-10T12:31:21.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~262s 2023-08-10T12:31:21.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~255s 2023-08-10T12:31:21.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~262s 2023-08-10T12:31:26.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-08-10T12:31:26.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2023-08-10T12:31:26.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2023-08-10T12:31:26.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-08-10T12:31:26.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2023-08-10T12:31:26.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2023-08-10T12:31:26.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2023-08-10T12:31:26.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~260s 2023-08-10T12:31:26.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~260s 2023-08-10T12:31:26.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~260s 2023-08-10T12:31:26.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~267s 2023-08-10T12:31:26.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2023-08-10T12:31:26.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2023-08-10T12:31:26.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~267s 2023-08-10T12:31:26.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~267s 2023-08-10T12:31:26.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~260s 2023-08-10T12:31:26.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~267s 2023-08-10T12:31:31.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-08-10T12:31:31.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2023-08-10T12:31:31.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2023-08-10T12:31:31.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-08-10T12:31:31.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2023-08-10T12:31:31.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-08-10T12:31:31.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2023-08-10T12:31:31.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2023-08-10T12:31:31.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2023-08-10T12:31:31.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2023-08-10T12:31:31.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~272s 2023-08-10T12:31:31.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~265s 2023-08-10T12:31:31.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2023-08-10T12:31:31.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~272s 2023-08-10T12:31:31.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~272s 2023-08-10T12:31:31.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~265s 2023-08-10T12:31:31.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~272s 2023-08-10T12:31:36.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-08-10T12:31:36.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2023-08-10T12:31:36.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2023-08-10T12:31:36.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2023-08-10T12:31:36.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2023-08-10T12:31:36.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2023-08-10T12:31:36.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2023-08-10T12:31:36.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~270s 2023-08-10T12:31:36.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~270s 2023-08-10T12:31:36.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~270s 2023-08-10T12:31:36.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~277s 2023-08-10T12:31:36.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2023-08-10T12:31:36.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2023-08-10T12:31:36.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~277s 2023-08-10T12:31:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~277s 2023-08-10T12:31:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~270s 2023-08-10T12:31:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~277s 2023-08-10T12:31:41.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2023-08-10T12:31:41.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2023-08-10T12:31:41.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2023-08-10T12:31:41.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2023-08-10T12:31:41.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2023-08-10T12:31:41.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-08-10T12:31:41.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2023-08-10T12:31:41.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~275s 2023-08-10T12:31:41.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~275s 2023-08-10T12:31:41.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~275s 2023-08-10T12:31:41.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~282s 2023-08-10T12:31:41.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~275s 2023-08-10T12:31:41.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~275s 2023-08-10T12:31:41.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~282s 2023-08-10T12:31:41.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~282s 2023-08-10T12:31:41.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~275s 2023-08-10T12:31:41.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~282s 2023-08-10T12:31:46.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~280s 2023-08-10T12:31:46.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2023-08-10T12:31:46.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2023-08-10T12:31:46.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2023-08-10T12:31:46.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~280s 2023-08-10T12:31:46.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~280s 2023-08-10T12:31:46.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2023-08-10T12:31:46.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2023-08-10T12:31:46.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2023-08-10T12:31:46.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2023-08-10T12:31:46.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~287s 2023-08-10T12:31:46.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2023-08-10T12:31:46.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-08-10T12:31:46.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~287s 2023-08-10T12:31:46.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~287s 2023-08-10T12:31:46.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~280s 2023-08-10T12:31:46.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~287s 2023-08-10T12:31:51.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~285s 2023-08-10T12:31:51.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~285s 2023-08-10T12:31:51.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~285s 2023-08-10T12:31:51.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2023-08-10T12:31:51.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~285s 2023-08-10T12:31:51.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2023-08-10T12:31:51.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~285s 2023-08-10T12:31:51.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~285s 2023-08-10T12:31:51.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2023-08-10T12:31:51.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2023-08-10T12:31:51.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~292s 2023-08-10T12:31:51.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~285s 2023-08-10T12:31:51.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2023-08-10T12:31:51.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~292s 2023-08-10T12:31:51.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~292s 2023-08-10T12:31:51.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~285s 2023-08-10T12:31:51.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~292s 2023-08-10T12:31:56.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~290s 2023-08-10T12:31:56.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~290s 2023-08-10T12:31:56.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2023-08-10T12:31:56.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2023-08-10T12:31:56.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2023-08-10T12:31:56.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~290s 2023-08-10T12:31:56.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2023-08-10T12:31:56.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2023-08-10T12:31:56.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2023-08-10T12:31:56.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2023-08-10T12:31:56.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~297s 2023-08-10T12:31:56.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2023-08-10T12:31:56.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2023-08-10T12:31:56.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~297s 2023-08-10T12:31:56.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~297s 2023-08-10T12:31:56.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~290s 2023-08-10T12:31:56.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~297s 2023-08-10T12:32:01.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~295s 2023-08-10T12:32:01.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~295s 2023-08-10T12:32:01.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2023-08-10T12:32:01.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~295s 2023-08-10T12:32:01.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~295s 2023-08-10T12:32:01.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~295s 2023-08-10T12:32:01.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~295s 2023-08-10T12:32:01.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~295s 2023-08-10T12:32:01.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~295s 2023-08-10T12:32:01.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~295s 2023-08-10T12:32:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~302s 2023-08-10T12:32:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~295s 2023-08-10T12:32:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~295s 2023-08-10T12:32:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~302s 2023-08-10T12:32:01.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~302s 2023-08-10T12:32:01.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~295s 2023-08-10T12:32:01.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~302s 2023-08-10T12:32:01.491 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-08-10T12:32:01.492 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T12:32:01.492 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:32:28.784 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-10T12:32:28.789 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/daemonwatchdog.py", line 61, in bark File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/mount.py", line 220, in is_mounted File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e paramiko.ssh_exception.SSHException: Unable to open channel. 2023-08-10T12:32:28.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:32:28.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:32:29.344 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-08-10T12:32:29.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:32:29.591 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T12:32:29.591 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:32:29.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251220k,nr_inodes=4062805,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5689 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253760k,mode=700,uid=1000,gid=1285 0 0 2023-08-10T12:32:29.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-08-10T12:32:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T12:32:29.610 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-10T12:32:29.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T12:32:29.667 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-08-10T12:32:29.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-08-10T12:32:29.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:32:29.744 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: Authentication failed. 2023-08-10T12:32:29.749 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-08-10T12:32:29.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T12:32:31.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:32:31.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:32:31.857 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-08-10T12:32:31.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-08-10T12:32:31.930 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T12:32:31.930 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:32:31.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251220k,nr_inodes=4062805,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5689 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253760k,mode=700,uid=1000,gid=1285 0 0 2023-08-10T12:32:31.991 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-08-10T12:32:31.992 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:32:32.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251220k,nr_inodes=4062805,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5689 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253760k,mode=700,uid=1000,gid=1285 0 0 2023-08-10T12:32:32.053 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-08-10T12:32:32.054 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:32:32.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')